-- Logs begin at Tue 2022-05-24 09:20:25 UTC, end at Tue 2022-05-24 10:39:29 UTC. -- May 24 10:05:02.262281 dv-cinder-810457-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 10:05:02.270905 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 10:05:02 2022] *** May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: nodename: dv-cinder-810457-9-iscsi May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: machine: x86_64 May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: clock source: unix May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: pcre jit disabled May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: detected number of CPU cores: 4 May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: current working directory: / May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: detected binary path: /usr/bin/uwsgi-core May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: your processes number limit is 47680 May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: your memory page size is 4096 bytes May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: detected max file descriptor number: 2048 May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: lock engine: pthread robust mutexes May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: thunder lock: enabled May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 10:05:02.273338 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 10:05:02.318981 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: Python main interpreter initialized at 0x555cfdf9f9c0 May 24 10:05:02.318981 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: python threads support enabled May 24 10:05:02.318981 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: your server socket listen backlog is limited to 100 connections May 24 10:05:02.318981 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: your mercy for graceful operations on workers is 90 seconds May 24 10:05:02.319317 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: mapped 403077 bytes (393 KB) for 2 cores May 24 10:05:02.319402 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: *** Operational MODE: preforking *** May 24 10:05:02.319651 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: *** uWSGI is running in multiple interpreter mode *** May 24 10:05:02.319651 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: spawned uWSGI master process (pid: 103653) May 24 10:05:02.319866 dv-cinder-810457-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 10:05:02.320503 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: spawned uWSGI worker 1 (pid: 103654, cores: 1) May 24 10:05:02.322778 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: spawned uWSGI worker 2 (pid: 103655, cores: 1) May 24 10:05:02.322778 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 10:05:03.498526 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 10:05:03.500887 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 10:05:04.224465 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:05:04.224465 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: from cryptography.utils import int_from_bytes May 24 10:05:04.224775 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:05:04.224775 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: from cryptography.utils import int_from_bytes May 24 10:05:04.226061 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:05:04.226061 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: from cryptography.utils import int_from_bytes May 24 10:05:04.226471 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:05:04.226471 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: from cryptography.utils import int_from_bytes May 24 10:05:06.844712 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 10:05:06.845257 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 10:05:06.845473 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 10:05:06.845832 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 10:05:06.846091 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 10:05:06.846474 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.846797 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.846964 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 10:05:06.847323 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.847412 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 10:05:06.847506 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.847722 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 10:05:06.847843 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.848053 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.848147 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 10:05:06.848365 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 10:05:06.848476 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.848681 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.848791 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849005 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849099 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849267 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849367 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849576 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849674 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849897 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-9-iscsi {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.849998 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.850214 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.850308 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.850519 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.850605 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.850827 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.850923 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.851769 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.851951 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.852045 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.852132 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.852350 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.852451 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.852653 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.852741 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-9-iscsi {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.853068 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.853162 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.853381 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.853576 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.853701 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.853896 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.854014 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.854193 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.854331 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.854527 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.854658 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.854837 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.854973 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.855145 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.855397 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.855547 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.855708 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.855817 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.856045 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.856147 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.856360 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.856458 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.856699 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.856800 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-9-iscsi {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.857014 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.857109 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.857326 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.857420 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.857646 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.857750 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.857956 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.858053 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.858284 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.858422 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.858596 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.858696 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.858936 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.859032 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-9-iscsi {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.859256 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.859358 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.859561 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.859648 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.859908 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.860011 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.860226 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.860320 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.860542 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.860637 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.860856 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.860944 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.861153 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.861247 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.861458 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.861545 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.861763 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.861866 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.862078 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.862165 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.862378 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.862493 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.862677 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.862764 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.862924 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.863018 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.863324 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.863423 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.863634 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.863728 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.863965 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.864053 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.864285 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.864389 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.864554 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.864693 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.864798 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.864898 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.865105 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.865257 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.865390 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.865484 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.865712 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.865807 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.866013 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.866100 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.866316 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.866404 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.866577 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.866674 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.866866 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.867030 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.867294 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.867383 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.867623 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.867723 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.867959 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.868060 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.868277 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.868365 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.868587 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.868683 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.868894 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.868982 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.869201 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.869295 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.869507 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.869608 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.869814 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.869909 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.870120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.870218 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.870422 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.870509 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.870739 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.870833 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.871073 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.871211 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.871360 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.871447 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.871671 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.871763 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.872015 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.872114 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.872319 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.872418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.872622 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.872710 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.872924 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.873024 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.873239 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.873332 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.873557 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.873649 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.873854 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.873951 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.874101 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.874189 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.874398 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.874499 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.874701 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.874818 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.875017 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.875119 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.875323 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.875464 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.875624 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.875721 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.875946 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.876036 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.876237 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.876334 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.876535 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.876634 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.876838 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.876923 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.877138 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.877231 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.877440 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.877529 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.877743 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.877829 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.878039 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.878125 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.878340 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.878435 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.878640 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.878728 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.878939 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.879032 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.879241 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.879328 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.879545 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.879639 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.879874 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.879977 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.880163 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.880251 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.880462 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.880564 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.880763 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.880865 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.881067 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.881155 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.881363 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.881461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.881663 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.881758 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.881979 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.882065 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.882277 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.882370 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.882608 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.882704 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.882916 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.883011 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.883233 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.883320 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.883539 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.883633 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.883863 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.883955 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.884186 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.884273 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.884491 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.884589 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.884801 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.884908 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.885101 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.885202 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.885406 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.885514 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.885705 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.885801 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886007 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886101 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886303 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886401 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886604 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886700 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886903 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.886992 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.887203 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.887305 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.887500 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.887594 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.887842 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.887932 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.888126 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.888221 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.888434 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.888527 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.888736 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.888822 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.889037 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.889124 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.889339 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.889431 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.889640 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.889728 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.889960 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.890048 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.890282 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.890377 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.890591 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.890686 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.890899 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.890988 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.891207 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.891303 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.891526 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:05:06.891632 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.891850 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.891951 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.892165 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.892252 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.892486 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.892585 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.892796 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.892884 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.893103 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.893198 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.893411 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.893511 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.893725 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.893812 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.894038 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.894126 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.894362 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.894460 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.894676 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.894763 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.894989 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.895086 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.895299 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.895404 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.895605 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.895693 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.895941 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.896029 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.896260 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.896351 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.896575 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.896660 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.896880 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.896975 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.897196 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.897283 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.897515 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.897601 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.897827 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.897921 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.898661 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.898756 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.898981 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.899228 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.899320 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.899401 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.899588 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.899704 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.899944 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.900100 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.900268 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.900451 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.900600 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.900767 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.900910 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.901096 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.901212 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.901419 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.901516 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.901736 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.901832 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.902050 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.902145 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.902366 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.902455 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.902691 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.902787 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.903023 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.903118 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.903333 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.903429 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.903645 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.903734 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.903978 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.904067 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.904288 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.904375 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.904595 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.904683 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.904902 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.905013 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.905213 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.905310 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.905508 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.905595 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.905807 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.905905 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.906106 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.906201 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.906410 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.906506 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.906709 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.906878 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.907024 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.907114 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.907337 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.907423 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.907638 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.907734 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.907963 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.908051 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.908269 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.908356 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.908573 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.908662 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.908875 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.908972 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.909175 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.909262 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.909474 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.909561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.909780 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.909875 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.910087 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.910175 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.910386 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.910474 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.910703 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.910790 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.911009 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.911097 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.911308 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.911396 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.911616 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.911711 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.911938 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.912044 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.912241 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.912335 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.912549 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.912678 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.912852 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.912991 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.913158 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.913255 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.913465 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.913553 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.914370 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.914578 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.914686 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.914813 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.914968 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.915061 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.915276 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.915401 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.915590 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.915689 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.915921 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.916012 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.916226 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.916315 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.916534 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.916621 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.916845 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.916932 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.917154 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.917241 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.917453 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.917553 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.917758 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.917853 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.918061 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.918150 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.918365 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.918453 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.918666 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.918753 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.918970 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.919060 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.919269 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.919364 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.919569 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.919667 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.919890 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.919982 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.920192 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.920279 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.920490 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.920590 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.920805 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.920894 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.921110 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.921205 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.921409 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.921506 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.921710 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.921815 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.922006 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.922099 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.922309 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.922409 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.922613 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.922701 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.922918 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.923005 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.923240 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.923336 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.923550 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.923638 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.923873 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.923976 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.924183 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.924281 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.924488 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.924576 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.924798 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.924884 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.925108 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.925197 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.925424 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.925522 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.925730 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.925819 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.926046 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.926135 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.926354 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.926441 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.926670 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.926774 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.926976 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.927074 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.927285 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.927372 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.927588 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.927682 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.927927 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.928029 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.928220 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.928314 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.928533 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.928634 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.928846 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.928933 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.929166 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.929334 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.929503 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.929608 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.929810 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.929896 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.930111 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.930202 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.930422 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.930524 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.930726 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.930819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.931031 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.931118 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.931338 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.931434 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.931643 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.931730 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.931993 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.932097 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.932301 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.932391 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.932613 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.932743 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933066 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933205 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933205 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933373 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933526 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933616 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933838 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.933925 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.934134 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.934222 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.934443 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.934538 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.934750 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.934844 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.935068 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.935169 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.935379 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.935482 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.935685 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.935927 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.936019 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.936095 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.936322 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.936418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.936622 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.936719 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.936929 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.937016 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.937232 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.937329 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.937533 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.937630 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.937840 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.937929 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.938151 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.938248 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.938459 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.938555 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.938764 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.938852 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.939062 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.939149 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.939371 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.939459 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.939672 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.939766 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.939996 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.940084 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.940293 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.940381 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.940598 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.940686 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.940905 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.940990 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.941212 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.941324 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.941513 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.941607 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.941827 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.941923 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.942124 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.942211 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.942423 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.942520 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.942723 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.942819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.943032 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.943177 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.943328 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.943426 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.943628 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.943726 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.943948 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.944039 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.944284 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.944372 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.944587 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.944684 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.944907 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.944998 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.945224 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.945318 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.945533 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.945637 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.945835 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.945926 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.946135 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.946265 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.946436 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.946526 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.946739 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.946833 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.947054 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.947142 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.947358 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.947448 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.947660 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.947748 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.947991 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.948092 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.948297 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.948387 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.948616 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.948742 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.948914 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.949010 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.949222 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.949326 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.949524 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.949612 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.949832 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.949933 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.950138 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.950224 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.950434 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.950521 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.950738 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.950837 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.951047 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.951133 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.951356 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.951604 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.951705 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.952220 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.952312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.952534 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.952630 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.952840 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.952927 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.953143 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.953286 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.953451 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.953548 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.953766 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.953869 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.954085 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.954333 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.954421 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.954672 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.954774 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.954993 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.955095 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.955296 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.955389 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.955596 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.955685 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.955925 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.956026 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.956227 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.956354 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.956527 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.956615 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.956829 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.956930 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.957133 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.957232 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.957433 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.957520 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.957734 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.957821 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.958034 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.958123 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.958336 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.958424 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.958647 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.958736 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.958947 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.959037 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.959256 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.959351 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.959555 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.959651 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.959876 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.959966 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.960185 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.960274 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.960982 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.961098 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.961292 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.961381 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.961593 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.961681 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.961898 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.961994 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.962211 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.962300 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.962516 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.962605 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.962839 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.962938 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.963152 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.963240 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.963457 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.963545 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.963754 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.963895 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.964081 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.964177 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.964426 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.964562 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.964731 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.964821 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.965041 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.965135 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.965355 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.965450 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.965667 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.965756 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.965966 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.966054 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.966271 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.966359 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.966577 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.966665 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.966883 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.966972 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.967183 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.967269 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.967479 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.967574 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.967785 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.967893 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.968106 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.968204 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.968408 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.968504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.968709 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.968796 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.969007 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.969104 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.969306 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.969402 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.969612 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.969746 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.969912 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.970009 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.970209 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.970296 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.970512 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.970598 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.970810 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.970907 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.971119 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.971206 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.971416 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.971501 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.971716 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.971824 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.972039 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.972126 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.972346 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.972441 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.972648 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.972735 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.972944 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.973036 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.973248 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.973336 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.973554 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.973641 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.973854 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.973969 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.974154 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.974242 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.974455 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.974542 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.974749 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.974843 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.975047 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.975144 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.975349 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.975435 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.975667 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.975753 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.976000 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.976179 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.976380 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.976475 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.976739 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.976833 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.977054 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.977157 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.977360 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.977448 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.977665 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.977752 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.977977 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.978073 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.978272 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.978366 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.978571 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.978659 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.978870 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.978960 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.979168 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.979265 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.979467 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.979554 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.979777 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.979941 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.980101 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.980191 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.980403 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.980489 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.980702 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.980789 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.980999 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.981094 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.981301 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.981387 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.981602 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.981691 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.981902 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.981990 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.982223 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.982320 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.982536 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.982626 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.982842 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.982938 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.983146 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.983248 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.983449 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.983534 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.983756 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.983870 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.984078 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.984179 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.984390 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.984478 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.984697 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.984784 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.985006 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.985103 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.985305 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.985399 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.985604 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.985692 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.985927 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.986024 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.986233 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.986321 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.986536 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.986630 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.986852 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.986939 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.987160 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.987245 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.987474 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.987570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.987771 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.987924 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.988098 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.988185 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.988401 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.988487 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.988706 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.988804 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.989008 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.989096 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.989312 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.989401 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.989616 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.989706 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.989921 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.990009 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.990227 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.990326 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.990534 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.990628 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.990837 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.990923 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.991140 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.991237 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.991445 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.991531 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.992297 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.992395 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.992626 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.992802 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.992940 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.993141 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.993238 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.993452 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.993548 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.993757 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.993846 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.994065 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.994153 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.994367 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.994464 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.994674 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.994768 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.994975 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.995063 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.995326 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.995421 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.995637 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.995727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.995967 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.996056 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.996278 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.996376 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.996583 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.996672 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.996888 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.996977 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.997189 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.997284 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.997495 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.997615 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.997795 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.997928 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.998212 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.998301 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.998521 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.998608 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.998828 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.998926 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.999133 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.999221 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.999435 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.999525 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.999735 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:06.999873 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.000065 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.000154 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.000384 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.000470 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.000685 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.000780 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.000985 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.001074 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.001284 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.001380 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.001600 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.001697 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.001899 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.001993 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.002215 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.002304 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.002552 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.002648 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.002856 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.002944 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.003158 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.003246 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.003469 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.003606 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.003782 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.003937 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.004105 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.004245 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.004426 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.004565 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.004844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.004933 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.005154 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.005248 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.005458 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.005554 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.005780 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.005873 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.006087 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.006183 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.006411 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.006501 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.006733 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.006836 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.007041 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.007136 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.007372 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.008030 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.008246 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.008335 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.008569 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.008657 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.008889 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.008988 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.009201 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.009291 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.009521 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.009611 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.009870 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.009958 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.010186 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.010283 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.010492 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.010581 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.010813 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.010912 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.011133 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.011220 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.011433 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.011534 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.011731 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.011849 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.012062 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.012179 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.012363 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.012501 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.012663 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.012812 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.012981 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.013133 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.013280 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.013457 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.013585 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.013761 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.013889 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.014065 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.014191 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.014377 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.014474 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.014680 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.014773 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.014981 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.015070 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.015304 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.015403 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.015609 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.015699 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.015947 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.016050 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.016258 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.016357 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.016566 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.016655 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.016869 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.017007 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.017172 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.017262 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.017473 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.017568 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.017774 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.017862 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.018072 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.018162 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.018369 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.018457 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.018697 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.018784 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.018996 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.019084 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.019311 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.019404 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.019632 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.019727 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.019964 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.020055 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.020270 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.020371 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.020574 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.020672 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.020876 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.020972 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.021201 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.021288 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.021506 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.021605 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.021823 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.021911 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.022123 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.022211 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.022421 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.022586 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.022726 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.022814 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.023081 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.023173 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.023439 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.023560 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.023741 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.023903 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.024073 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.024224 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.024373 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.024550 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.024671 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.024854 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.024971 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.025158 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.025289 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.025468 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.025588 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.025770 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.025904 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.026072 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.026211 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.026376 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.026519 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.026685 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.026819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.026986 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.027119 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.027288 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.027441 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.027589 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.027741 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.027932 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.028094 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.028235 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.028405 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.028558 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.028721 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.028885 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.029043 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.029167 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.029348 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.029470 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.029666 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.029766 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.029976 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.030100 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.030285 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.030402 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.030597 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.030735 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.030908 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.031050 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.031218 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.031370 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.031527 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.031694 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.031855 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.032032 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.032163 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.032355 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.032456 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.032669 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.032758 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.032983 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.033071 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.033297 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.033572 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.033663 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.033898 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.033986 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.034210 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.034297 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.034520 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.034607 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.034829 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.034915 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.035140 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.035241 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.035447 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.035537 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.035755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.035859 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.036090 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.036297 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.036388 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.036625 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.036762 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.036944 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.037033 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.037260 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.037357 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.037576 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.037665 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.037892 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.037982 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.038205 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.038294 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.038517 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.038768 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.038864 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.039042 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.039234 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.039597 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.039687 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.039940 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.040100 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.040248 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.040443 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.040560 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.040774 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.040863 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.041108 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.041205 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.041448 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.041539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.041754 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.041840 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.042064 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.042161 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.042372 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.042469 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.042678 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.042767 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.042984 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.043074 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.043291 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.043387 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.043601 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.043704 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.043949 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.044080 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.044273 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.044380 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.044586 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.044682 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.044897 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.044994 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.045208 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.045295 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.045516 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.045615 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.045830 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.046030 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.046130 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.046347 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.046444 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.046674 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.046771 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.046995 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.047084 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.047315 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.047458 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.047624 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.047714 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.047970 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.048061 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.048295 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.048443 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.048597 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.048690 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.048899 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.048987 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.049206 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.049425 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.049516 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.049743 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.049831 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.050075 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.050173 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.050395 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.050481 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.050695 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.050782 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.051010 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.051112 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.051315 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.051403 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.051641 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.051861 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.051968 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.052206 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.052296 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.052521 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.052610 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.052843 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.052940 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.053151 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.053238 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.053465 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.053551 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.053769 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.053866 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.054070 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.054165 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.054922 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.055014 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.055241 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.055351 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.055575 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.055772 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.055936 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.056145 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.056248 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.056464 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.056553 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.056782 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.056871 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.057090 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.057187 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.057389 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.057477 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.057697 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.057793 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.057998 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.058099 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.058311 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.058399 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.058609 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.058695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.058910 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.059072 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.059210 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.059298 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.059511 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.059597 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.059835 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.059926 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.060130 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.060218 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.060430 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.060518 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.060730 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.060820 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.061036 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.061123 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.061333 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.061418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.061638 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.061728 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.061941 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.062030 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.062242 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.062328 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.062540 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.062627 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.062845 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.062933 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.063144 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.063239 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.063447 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.063535 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.063750 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.063857 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.064075 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.064177 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.064384 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.064474 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.064687 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.064775 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.064995 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.065096 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.065299 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.065389 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.065610 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.065699 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.065913 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.066010 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.066222 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.066311 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.066567 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.066828 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.066924 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.067161 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.067260 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.067465 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.067551 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.067780 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.067929 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.068115 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.068204 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.068425 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.068512 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.068728 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.068825 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.069033 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.069129 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.069354 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.069444 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.069665 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.069767 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.070571 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.070761 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.070924 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.071103 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.071283 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.071430 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.071592 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.071768 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.071924 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.072127 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.072231 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.072441 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.072538 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.072751 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.072846 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.073063 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.073161 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.073388 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.073477 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.073692 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.073777 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.074002 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.074091 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.074310 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.074397 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.074621 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.074709 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.074932 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.075024 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.075243 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.075329 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.075549 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.075636 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.075872 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.075964 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.076178 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.076284 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.076484 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.076573 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.077054 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.077191 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.077371 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.077458 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.077684 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.077785 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.077992 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.078078 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.078294 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.078385 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.078630 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.078726 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.078945 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.079035 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.079262 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.079350 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.079577 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.079674 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.079911 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.080001 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.080222 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.080310 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.080531 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.080622 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.080838 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.080925 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.081158 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.081247 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.081465 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.081554 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.081767 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.081853 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.082111 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.082198 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.082436 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.082526 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.082757 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.082846 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.083060 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.083162 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.083361 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.083450 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.083661 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.083749 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.083994 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.084096 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.084309 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.084398 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.084614 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.084702 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.084912 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.085009 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.085211 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.085298 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.085554 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.085654 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.085857 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.085947 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.086207 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.086293 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.086513 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.086602 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.086817 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.086906 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.087121 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.087206 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.087417 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.087502 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.087717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.087842 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.088043 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.088133 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.088341 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.088428 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.088640 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.088729 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.088936 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.089022 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.089241 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.089338 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.089539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.089633 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.089840 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.089937 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.090138 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.090240 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.090438 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.090527 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.090735 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.090823 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.091036 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.091133 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.091339 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.091429 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.091638 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.091726 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.091963 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.092065 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.092268 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.092357 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.092577 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.092665 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.092882 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.092979 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.093184 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.093274 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.093487 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.093575 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.093788 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.093886 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.094087 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.094178 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.094420 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.094510 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.094787 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.094881 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.095050 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.095139 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.095355 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.095451 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.095661 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.095758 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.095994 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.096085 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.096299 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.096395 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.096620 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.096708 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.096937 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.097023 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.097234 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.097372 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.097543 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.097631 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.097852 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.097948 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.098166 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.098262 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.098474 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.098562 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.098776 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.098865 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.099083 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.099172 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.099391 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.099485 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.099695 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.099785 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.100031 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.100129 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.100339 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.100428 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.100640 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.100727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.100949 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.101075 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.101287 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.101374 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.101605 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.101703 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.101918 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.102007 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.102222 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.102310 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.102542 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.102639 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.102849 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.102936 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.103157 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.103246 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.103468 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.103567 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.103777 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.103888 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.104108 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.104197 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.104422 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.104513 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.104727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.104814 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.105028 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.105117 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.105267 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103655) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 10:05:07.105365 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.105654 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.105976 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.106302 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.106645 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.106954 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.107295 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.107621 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.107956 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.108269 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.108573 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:05:07.108818 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103654) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 10:05:07.164389 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO dbcounter [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Registered counter for database nova_api May 24 10:05:07.168794 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Registered counter for database nova_api May 24 10:05:07.185008 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_db.sqlalchemy.engines [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.188479 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.191539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writer thread running {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.195042 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.247659 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.context [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7fc9cc-559b-4c6a-9445-47ad843e2912(cell1) {{(pid=103655) load_cells /opt/stack/nova/nova/context.py:464}} May 24 10:05:07.251032 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.context [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7fc9cc-559b-4c6a-9445-47ad843e2912(cell1) {{(pid=103654) load_cells /opt/stack/nova/nova/context.py:464}} May 24 10:05:07.251764 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_concurrency.lockutils [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:05:07.253346 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_concurrency.lockutils [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:05:07.254120 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_concurrency.lockutils [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:05:07.255122 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:05:07.256069 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_concurrency.lockutils [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103655) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:05:07.256737 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:05:07.258045 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:05:07.258546 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO dbcounter [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Registered counter for database nova_cell0 May 24 10:05:07.260030 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:05:07.262012 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Registered counter for database nova_cell0 May 24 10:05:07.262590 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO dbcounter [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Registered counter for database nova_cell1 May 24 10:05:07.265932 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Registered counter for database nova_cell1 May 24 10:05:07.270334 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_db.sqlalchemy.engines [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.272036 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_db.sqlalchemy.engines [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.275167 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.276790 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.278938 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writer thread running {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.281044 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writer thread running {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.282231 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.284807 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.427357 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO dbcounter [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Registered counter for database nova_cell0 May 24 10:05:07.428666 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO dbcounter [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Registered counter for database nova_cell0 May 24 10:05:07.436440 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG oslo_db.sqlalchemy.engines [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103655) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.438015 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_db.sqlalchemy.engines [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103654) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:05:07.441000 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writer thread running {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.442432 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writer thread running {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:05:07.851566 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:05:07.858912 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:05:07.874771 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: WARNING keystonemiddleware.auth_token [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:05:07.882031 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: WARNING keystonemiddleware.auth_token [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:05:08.201078 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:05:08.207179 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: WARNING keystonemiddleware.auth_token [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:05:08.212678 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555cfdf9f9c0 pid: 103654 (default app) May 24 10:05:08.214759 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:05:08.215981 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001739 May 24 10:05:08.216397 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Tue May 24 10:05:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:05:08.222816 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: WARNING keystonemiddleware.auth_token [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:05:08.229449 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: WARNING keystonemiddleware.auth_token [None req-f548088e-9ed5-49aa-954f-d67323ec931a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:05:08.234667 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555cfdf9f9c0 pid: 103655 (default app) May 24 10:06:28.739003 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:28.740041 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 24 10:06:28.740472 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:28.757139 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writing DB stats nova_api:SELECT=3 {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:28.758260 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writing DB stats nova_cell1:SELECT=3 {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:28.759465 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writing DB stats nova_cell0:SELECT=3 {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:28.760221 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:29.198158 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-97da2c4a-08dd-4f5d-b5d1-213ca0fb7747 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:29.228682 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-97da2c4a-08dd-4f5d-b5d1-213ca0fb7747 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.481261 May 24 10:06:29.229331 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Tue May 24 10:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:31.486924 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:31.487970 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-a669ab18-4bd9-470f-854a-3d87a2141b2d None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 24 10:06:31.492102 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:31.554296 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-c39fbcff-09bf-4d49-bc54-db771c7ace5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:31.572370 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:31.572370 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: warnings.warn(msg) May 24 10:06:31.657483 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-c39fbcff-09bf-4d49-bc54-db771c7ace5d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.163160 May 24 10:06:31.658225 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:31.672232 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=3 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:31.673519 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell0:SELECT=3 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:31.674831 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell1:SELECT=3 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:31.675956 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:06:31.886306 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-20338d49-464d-4e4e-ae53-d470fc5af76f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:31.888915 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:31.888915 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: warnings.warn(msg) May 24 10:06:32.033154 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-20338d49-464d-4e4e-ae53-d470fc5af76f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.366298 May 24 10:06:32.033890 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Tue May 24 10:06:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:34.291625 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-c39fbcff-09bf-4d49-bc54-db771c7ace5d admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:34.293316 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-c39fbcff-09bf-4d49-bc54-db771c7ace5d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002216 May 24 10:06:34.293891 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:34.400131 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-bc25bd87-3e8f-4ec3-a827-c0e1afb58137 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "disk": 5}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:34.418112 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:34.418112 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: warnings.warn(msg) May 24 10:06:34.488886 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-bc25bd87-3e8f-4ec3-a827-c0e1afb58137 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.189165 May 24 10:06:34.489437 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:34.501408 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-2f4a941d-69a9-4807-9c21-fb674cba65ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:34.502887 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:06:34.502887 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: warnings.warn(msg) May 24 10:06:34.604878 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-2f4a941d-69a9-4807-9c21-fb674cba65ca admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107141 May 24 10:06:34.605474 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Tue May 24 10:06:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:36.863928 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-bc25bd87-3e8f-4ec3-a827-c0e1afb58137 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:36.865016 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-bc25bd87-3e8f-4ec3-a827-c0e1afb58137 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 May 24 10:06:36.865733 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:36.927160 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-a6c0f045-f108-45cf-b598-1fd3a7d7a7a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:37.012824 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-a6c0f045-f108-45cf-b598-1fd3a7d7a7a2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140936 May 24 10:06:37.017199 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:37.026445 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-6be7b179-222c-45ee-bf6b-2c510d1f1bd9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:37.142265 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-6be7b179-222c-45ee-bf6b-2c510d1f1bd9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119894 May 24 10:06:37.143028 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Tue May 24 10:06:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:06:39.410702 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-a6c0f045-f108-45cf-b598-1fd3a7d7a7a2 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:39.412468 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-a6c0f045-f108-45cf-b598-1fd3a7d7a7a2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 24 10:06:39.412905 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:39.475717 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-1463fcda-0d6b-41ec-8722-7a4f2f376e19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:39.545396 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-1463fcda-0d6b-41ec-8722-7a4f2f376e19 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.125796 May 24 10:06:39.545977 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:39.561472 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-c8b609e2-0bd4-4c9d-8a84-6340b5720931 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:39.642545 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-c8b609e2-0bd4-4c9d-8a84-6340b5720931 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084666 May 24 10:06:39.643286 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Tue May 24 10:06:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:41.981483 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-1463fcda-0d6b-41ec-8722-7a4f2f376e19 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:41.982498 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-1463fcda-0d6b-41ec-8722-7a4f2f376e19 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 24 10:06:41.982890 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:42.046772 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-b6f75e64-de66-4333-919a-dc2d7f000bd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:42.123141 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-b6f75e64-de66-4333-919a-dc2d7f000bd7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134085 May 24 10:06:42.123784 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:42.136514 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-94ed6db1-e592-40a7-838a-f95f296d3977 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:42.229048 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-94ed6db1-e592-40a7-838a-f95f296d3977 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096014 May 24 10:06:42.243850 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Tue May 24 10:06:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:44.486586 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-b6f75e64-de66-4333-919a-dc2d7f000bd7 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:44.487730 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-b6f75e64-de66-4333-919a-dc2d7f000bd7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 24 10:06:44.488231 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:44.556737 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-d4316500-fdff-42ea-b8e1-e071d5255bf2 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:44.580823 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-d4316500-fdff-42ea-b8e1-e071d5255bf2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085590 May 24 10:06:44.587208 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Tue May 24 10:06:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:06:47.068918 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-b6f75e64-de66-4333-919a-dc2d7f000bd7 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:47.069979 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-b6f75e64-de66-4333-919a-dc2d7f000bd7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 May 24 10:06:47.070385 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:47.131397 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-4fc37f0e-7fd0-4d6e-89c8-8962333aeaae admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:47.222230 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-4fc37f0e-7fd0-4d6e-89c8-8962333aeaae admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.145837 May 24 10:06:47.223266 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:47.235697 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-242f9d9d-27d8-4ae9-9f22-99e6c908dae6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:47.309322 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-242f9d9d-27d8-4ae9-9f22-99e6c908dae6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077230 May 24 10:06:47.309801 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Tue May 24 10:06:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:49.542957 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-4fc37f0e-7fd0-4d6e-89c8-8962333aeaae admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:49.543972 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-4fc37f0e-7fd0-4d6e-89c8-8962333aeaae admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 24 10:06:49.544409 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:49.611528 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-c5a64ab7-71fe-4468-afce-6070ea67edab admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:49.685238 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-c5a64ab7-71fe-4468-afce-6070ea67edab admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134763 May 24 10:06:49.685988 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:49.699683 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-19aa24fa-c2b6-4699-80a1-e6ec79040864 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:49.777298 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-19aa24fa-c2b6-4699-80a1-e6ec79040864 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081188 May 24 10:06:49.777823 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Tue May 24 10:06:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:52.018265 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-c5a64ab7-71fe-4468-afce-6070ea67edab admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:52.019281 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-c5a64ab7-71fe-4468-afce-6070ea67edab admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 24 10:06:52.019689 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:52.083513 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-731a2786-edf2-4b8d-be3f-7cbfb9c32e42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:52.151890 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-731a2786-edf2-4b8d-be3f-7cbfb9c32e42 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.125143 May 24 10:06:52.152362 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:52.165080 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-aefb41ab-769c-4895-be9b-e64388cd1430 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:52.234067 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-aefb41ab-769c-4895-be9b-e64388cd1430 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073294 May 24 10:06:52.234601 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Tue May 24 10:06:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:54.470972 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-731a2786-edf2-4b8d-be3f-7cbfb9c32e42 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:54.471986 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-731a2786-edf2-4b8d-be3f-7cbfb9c32e42 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 May 24 10:06:54.472385 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:54.528442 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-7a216f38-5759-4e55-be6d-80fc93ea60fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:54.625189 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-7a216f38-5759-4e55-be6d-80fc93ea60fa admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146757 May 24 10:06:54.625775 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:06:54.638157 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-f1da959c-8da4-4358-892e-2e153f8169ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:54.718284 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-f1da959c-8da4-4358-892e-2e153f8169ff admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084112 May 24 10:06:54.718875 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Tue May 24 10:06:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:06:57.065354 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-7a216f38-5759-4e55-be6d-80fc93ea60fa admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:06:57.068576 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-7a216f38-5759-4e55-be6d-80fc93ea60fa admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 24 10:06:57.068576 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:06:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:06:57.136188 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-b35e8ea7-437e-4ee6-99d0-68dbf17d022b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:57.655167 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-b35e8ea7-437e-4ee6-99d0-68dbf17d022b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.576309 May 24 10:06:57.656177 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Tue May 24 10:06:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:06:57.668428 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-7c25b527-bbff-4a41-bd59-4192f50bb00c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:06:57.811954 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-7c25b527-bbff-4a41-bd59-4192f50bb00c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147258 May 24 10:06:57.812791 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Tue May 24 10:06:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:07:22.393105 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-b35e8ea7-437e-4ee6-99d0-68dbf17d022b admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:22.394110 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-b35e8ea7-437e-4ee6-99d0-68dbf17d022b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 24 10:07:22.394539 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:07:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:22.405526 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:07:22.453741 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-c1f42960-900e-4e82-ba18-1c3f6a992178 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:22.471073 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-c1f42960-900e-4e82-ba18-1c3f6a992178 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070023 May 24 10:07:22.471608 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Tue May 24 10:07:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:23.454648 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-b35e8ea7-437e-4ee6-99d0-68dbf17d022b admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:23.455640 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-b35e8ea7-437e-4ee6-99d0-68dbf17d022b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 24 10:07:23.456065 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:23.672484 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-e97f760c-9f6b-4025-8b3a-24916ca4013e admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:23.678472 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.wsgi [None req-e97f760c-9f6b-4025-8b3a-24916ca4013e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-e97f760c-9f6b-4025-8b3a-24916ca4013e admin admin] Request method failure captured: May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Accept: application/json May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Accept-Encoding: gzip, deflate May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Connection: keep-alive May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Content-Length: 0 May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Host: 10.222.0.44 May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Openstack-Api-Version: compute 2.90 May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Openstack-System-Scope: None May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: User-Agent: python-novaclient May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Auth-Token: gAAAAABijK5bqZvUuDTNjsEES3mHxkrcWeZsSFkIQ93drIdsOiGa58_zOLd2oIc2zU1-Es0nV3qrhuH_XKuHhci5iN_o_4F3SvvezfMF21sek6DUEk58ceeuV5EJ3Rx606IpVUqjolMQc0NmuPENtL_y3GQNlDCCIwnQi-fegxYtZ_ud7kaYZB8 May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Domain-Id: None May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Domain-Name: None May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Identity-Status: Confirmed May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Is-Admin-Project: True May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Openstack-Nova-Api-Version: 2.90 May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Domain-Id: default May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Domain-Name: Default May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Name: admin May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Role: admin,member,reader May 24 10:07:23.681727 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Roles: admin,member,reader May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdda7d022db54add9754a061e49ddfb7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant: admin May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant-Name: admin May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User: admin May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Domain-Id: default May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Domain-Name: Default May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Id: a8aea1f45aa44e67a635de02ad254222 May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Name: admin May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: method: > May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: exception: Flavor 42 could not be found. May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: action_args: {'id': '42'} May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:07:23.683471 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:23.684819 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:23.686216 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-e97f760c-9f6b-4025-8b3a-24916ca4013e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:07:23.687515 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-e97f760c-9f6b-4025-8b3a-24916ca4013e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062490 May 24 10:07:23.687515 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Tue May 24 10:07:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 10:07:23.692973 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-484ff13f-b2ef-442e-9a56-8c38b0dda8de admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:23.695946 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:07:23.714876 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-484ff13f-b2ef-442e-9a56-8c38b0dda8de admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025562 May 24 10:07:23.715399 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Tue May 24 10:07:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:23.736861 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-7099299d-fa0e-42ef-9966-c971939b3ca9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:23.758004 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-7099299d-fa0e-42ef-9966-c971939b3ca9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024762 May 24 10:07:23.758545 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Tue May 24 10:07:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:07:23.767600 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-e766e219-00cf-4a0a-bdc1-5884d0b10c41 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:23.774215 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.wsgi [None req-e766e219-00cf-4a0a-bdc1-5884d0b10c41 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-e766e219-00cf-4a0a-bdc1-5884d0b10c41 admin admin] Request method failure captured: May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Accept: application/json May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Accept-Encoding: gzip, deflate May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Connection: keep-alive May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Content-Length: 0 May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Host: 10.222.0.44 May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Openstack-Api-Version: compute 2.90 May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Openstack-System-Scope: None May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: User-Agent: python-novaclient May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Auth-Token: gAAAAABijK5bqZvUuDTNjsEES3mHxkrcWeZsSFkIQ93drIdsOiGa58_zOLd2oIc2zU1-Es0nV3qrhuH_XKuHhci5iN_o_4F3SvvezfMF21sek6DUEk58ceeuV5EJ3Rx606IpVUqjolMQc0NmuPENtL_y3GQNlDCCIwnQi-fegxYtZ_ud7kaYZB8 May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Domain-Id: None May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Domain-Name: None May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Identity-Status: Confirmed May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Is-Admin-Project: True May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Openstack-Nova-Api-Version: 2.90 May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Domain-Id: default May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Domain-Name: Default May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Name: admin May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Role: admin,member,reader May 24 10:07:23.777461 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Roles: admin,member,reader May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdda7d022db54add9754a061e49ddfb7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant: admin May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant-Name: admin May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User: admin May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Domain-Id: default May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Domain-Name: Default May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Id: a8aea1f45aa44e67a635de02ad254222 May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Name: admin May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: method: > May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: exception: Flavor 42 could not be found. May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: action_args: {'id': '42'} May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:07:23.778999 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:23.785695 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:23.787317 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-e766e219-00cf-4a0a-bdc1-5884d0b10c41 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:07:23.788629 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-e766e219-00cf-4a0a-bdc1-5884d0b10c41 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014754 May 24 10:07:23.788629 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Tue May 24 10:07:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 10:07:24.640844 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-7099299d-fa0e-42ef-9966-c971939b3ca9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:24.641899 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-7099299d-fa0e-42ef-9966-c971939b3ca9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 24 10:07:24.642291 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:24.833780 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-2592776d-cafa-4e67-8fc1-0994a7c3ae42 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:24.839257 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.wsgi [None req-2592776d-cafa-4e67-8fc1-0994a7c3ae42 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-2592776d-cafa-4e67-8fc1-0994a7c3ae42 admin admin] Request method failure captured: May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Accept: application/json May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Accept-Encoding: gzip, deflate May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Connection: keep-alive May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Content-Length: 0 May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Host: 10.222.0.44 May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Openstack-Api-Version: compute 2.90 May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Openstack-System-Scope: None May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: User-Agent: python-novaclient May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Auth-Token: gAAAAABijK5cPVlyEyeyzImwTIBkk-48REQDFpgjg0m3n6WnnPKcRCX9UD0w5FSZ-8hYqmh99ZHZL_2EG955qPh5moJyiQebeBYS52oDVnujKrqlTngosRjKntyEauj9qyNvRakhb2lHZfaWFZmNubdj0p-KhhgmGTY0BAhuYDkzmHYcWHESlss May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Domain-Id: None May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Domain-Name: None May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Identity-Status: Confirmed May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Is-Admin-Project: True May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Openstack-Nova-Api-Version: 2.90 May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Domain-Id: default May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Domain-Name: Default May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Name: admin May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Role: admin,member,reader May 24 10:07:24.840811 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Roles: admin,member,reader May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdda7d022db54add9754a061e49ddfb7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant: admin May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant-Name: admin May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User: admin May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Domain-Id: default May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Domain-Name: Default May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Id: a8aea1f45aa44e67a635de02ad254222 May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Name: admin May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: method: > May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: exception: Flavor 84 could not be found. May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: action_args: {'id': '84'} May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:07:24.842418 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:24.843312 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:24.844844 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-2592776d-cafa-4e67-8fc1-0994a7c3ae42 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:07:24.846201 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-2592776d-cafa-4e67-8fc1-0994a7c3ae42 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061733 May 24 10:07:24.846201 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Tue May 24 10:07:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 10:07:24.852576 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-9af3cc0c-6fc1-45c7-a6f3-35b96948c07d admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:24.868366 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-9af3cc0c-6fc1-45c7-a6f3-35b96948c07d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019766 May 24 10:07:24.868898 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Tue May 24 10:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:24.878625 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-e8abf38e-c0a6-445d-8b94-86d08424f8b7 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:24.893527 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-e8abf38e-c0a6-445d-8b94-86d08424f8b7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018757 May 24 10:07:24.894048 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Tue May 24 10:07:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:24.903937 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-cb1e2b0f-288b-4755-b079-3e6b0233c72e admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:24.909214 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.wsgi [None req-cb1e2b0f-288b-4755-b079-3e6b0233c72e admin admin] HTTP exception thrown: Flavor 84 could not be found. May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-cb1e2b0f-288b-4755-b079-3e6b0233c72e admin admin] Request method failure captured: May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Accept: application/json May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Accept-Encoding: gzip, deflate May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Connection: keep-alive May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Content-Length: 0 May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Host: 10.222.0.44 May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Openstack-Api-Version: compute 2.90 May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Openstack-System-Scope: None May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: User-Agent: python-novaclient May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Auth-Token: gAAAAABijK5cPVlyEyeyzImwTIBkk-48REQDFpgjg0m3n6WnnPKcRCX9UD0w5FSZ-8hYqmh99ZHZL_2EG955qPh5moJyiQebeBYS52oDVnujKrqlTngosRjKntyEauj9qyNvRakhb2lHZfaWFZmNubdj0p-KhhgmGTY0BAhuYDkzmHYcWHESlss May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Domain-Id: None May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Domain-Name: None May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Identity-Status: Confirmed May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Is-Admin-Project: True May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Openstack-Nova-Api-Version: 2.90 May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Domain-Id: default May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Domain-Name: Default May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Name: admin May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Role: admin,member,reader May 24 10:07:24.910755 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Roles: admin,member,reader May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdda7d022db54add9754a061e49ddfb7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant: admin May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant-Name: admin May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User: admin May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Domain-Id: default May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Domain-Name: Default May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Id: a8aea1f45aa44e67a635de02ad254222 May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Name: admin May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: method: > May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: exception: Flavor 84 could not be found. May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: action_args: {'id': '84'} May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:07:24.912564 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:24.913504 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:24.914570 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-cb1e2b0f-288b-4755-b079-3e6b0233c72e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:07:24.915634 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-cb1e2b0f-288b-4755-b079-3e6b0233c72e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012191 May 24 10:07:24.915634 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Tue May 24 10:07:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 24 10:07:25.772360 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-e8abf38e-c0a6-445d-8b94-86d08424f8b7 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:25.773383 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-e8abf38e-c0a6-445d-8b94-86d08424f8b7 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 24 10:07:25.773776 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:25.962225 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-e210d935-41a0-4029-81cb-c4d39d25bcf6 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:25.967500 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.wsgi [None req-e210d935-41a0-4029-81cb-c4d39d25bcf6 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-e210d935-41a0-4029-81cb-c4d39d25bcf6 admin admin] Request method failure captured: May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Accept: application/json May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Accept-Encoding: gzip, deflate May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Connection: keep-alive May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Content-Length: 0 May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Host: 10.222.0.44 May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Openstack-Api-Version: compute 2.90 May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Openstack-System-Scope: None May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: User-Agent: python-novaclient May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Auth-Token: gAAAAABijK5dXxVfoL5RgFnyhoWfYJpQBj83xLsmhdoI7i96QjA_LJ5VC7tkUK2gn6r7tkstHPSx5mMqCRa2O531-ugEEseRlJucfKwsw0tl8L-r-j-zH-Joa8cRBhDVXF2XQjlJHsXIWoQhX3JM0PO7eWgfBsJhsN5G35jb-BaKumvz-opj8EM May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Domain-Id: None May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Domain-Name: None May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Identity-Status: Confirmed May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Is-Admin-Project: True May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Openstack-Nova-Api-Version: 2.90 May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Domain-Id: default May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Domain-Name: Default May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Project-Name: admin May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Role: admin,member,reader May 24 10:07:25.969188 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Roles: admin,member,reader May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdda7d022db54add9754a061e49ddfb7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant: admin May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-Tenant-Name: admin May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User: admin May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Domain-Id: default May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Domain-Name: Default May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Id: a8aea1f45aa44e67a635de02ad254222 May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: X-User-Name: admin May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: method: > May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: exception: Flavor 451 could not be found. May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: action_args: {'id': '451'} May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:07:25.970814 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:25.972717 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: ERROR nova.api.openstack.wsgi May 24 10:07:25.974539 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-e210d935-41a0-4029-81cb-c4d39d25bcf6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103655) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:07:25.975791 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-e210d935-41a0-4029-81cb-c4d39d25bcf6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061778 May 24 10:07:25.975791 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Tue May 24 10:07:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 10:07:25.981200 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-e691a6bc-e8c7-4ad7-91e2-e5e9d2f2fb5c admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:25.996580 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-e691a6bc-e8c7-4ad7-91e2-e5e9d2f2fb5c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018898 May 24 10:07:25.997055 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Tue May 24 10:07:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:26.007162 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:26.021062 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017554 May 24 10:07:26.021603 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Tue May 24 10:07:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:07:26.030995 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-4ef78a71-4fe3-40b9-ad39-4ec2c75acdde admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:26.037069 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.wsgi [None req-4ef78a71-4fe3-40b9-ad39-4ec2c75acdde admin admin] HTTP exception thrown: Flavor 451 could not be found. May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-4ef78a71-4fe3-40b9-ad39-4ec2c75acdde admin admin] Request method failure captured: May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Accept: application/json May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Accept-Encoding: gzip, deflate May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Connection: keep-alive May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Content-Length: 0 May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Host: 10.222.0.44 May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Openstack-Api-Version: compute 2.90 May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Openstack-System-Scope: None May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: User-Agent: python-novaclient May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Auth-Token: gAAAAABijK5dXxVfoL5RgFnyhoWfYJpQBj83xLsmhdoI7i96QjA_LJ5VC7tkUK2gn6r7tkstHPSx5mMqCRa2O531-ugEEseRlJucfKwsw0tl8L-r-j-zH-Joa8cRBhDVXF2XQjlJHsXIWoQhX3JM0PO7eWgfBsJhsN5G35jb-BaKumvz-opj8EM May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Domain-Id: None May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Domain-Name: None May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Identity-Status: Confirmed May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Is-Admin-Project: True May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Openstack-Nova-Api-Version: 2.90 May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Domain-Id: default May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Domain-Name: Default May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Project-Name: admin May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Role: admin,member,reader May 24 10:07:26.038561 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Roles: admin,member,reader May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fdda7d022db54add9754a061e49ddfb7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fdda7d022db54add9754a061e49ddfb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant: admin May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant-Id: fdda7d022db54add9754a061e49ddfb7 May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-Tenant-Name: admin May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User: admin May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Domain-Id: default May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Domain-Name: Default May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Id: a8aea1f45aa44e67a635de02ad254222 May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: X-User-Name: admin May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: method: > May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: exception: Flavor 451 could not be found. May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: action_args: {'id': '451'} May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:07:26.040120 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:26.041146 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: ERROR nova.api.openstack.wsgi May 24 10:07:26.042431 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-4ef78a71-4fe3-40b9-ad39-4ec2c75acdde admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103654) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:07:26.043677 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-4ef78a71-4fe3-40b9-ad39-4ec2c75acdde admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012436 May 24 10:07:26.043677 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Tue May 24 10:07:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 24 10:07:26.898555 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:26.899550 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 24 10:07:26.899990 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:27.086446 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-9f307a2f-8b3c-4dff-8850-2a6aa1e98a56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:27.170777 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-9f307a2f-8b3c-4dff-8850-2a6aa1e98a56 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.135446 May 24 10:07:27.171239 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Tue May 24 10:07:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:07:28.037469 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:28.038470 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 24 10:07:28.038870 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:28.227596 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-04303d13-2eab-4ce5-836f-9de65d4737e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:28.303972 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-04303d13-2eab-4ce5-836f-9de65d4737e2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.129055 May 24 10:07:28.304436 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Tue May 24 10:07:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:07:29.165579 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:29.166614 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 24 10:07:29.167009 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:29.354789 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-d0afb446-bc4b-4f30-8a69-d17f21a0af33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:29.479764 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-d0afb446-bc4b-4f30-8a69-d17f21a0af33 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.177181 May 24 10:07:29.481649 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Tue May 24 10:07:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:07:30.347696 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:30.349207 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001924 May 24 10:07:30.349602 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:30.540067 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-2e62399f-dd51-4d6b-97cc-94c5db4a2365 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:07:30.618615 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-2e62399f-dd51-4d6b-97cc-94c5db4a2365 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.133595 May 24 10:07:30.619161 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Tue May 24 10:07:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:07:31.492396 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:31.493452 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 24 10:07:31.493852 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:07:31.679569 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-cac7f1cf-9da0-4e4c-bdda-82bf54ccf5cf admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:07:31.699402 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-cac7f1cf-9da0-4e4c-bdda-82bf54ccf5cf admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071629 May 24 10:07:31.699882 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Tue May 24 10:07:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:08:33.570399 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:33.571403 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-ee102d4b-7599-4e49-b8cf-432b2805c3b9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 24 10:08:33.571815 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Tue May 24 10:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:08:33.579470 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:08:33.630822 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-b2f1587c-3504-4bc4-a366-2b0250cd1664 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:33.649898 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-b2f1587c-3504-4bc4-a366-2b0250cd1664 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072208 May 24 10:08:33.650424 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Tue May 24 10:08:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:08:33.671078 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG dbcounter [-] [103655] Writing DB stats nova_api:SELECT=14 {{(pid=103655) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:08:33.675771 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-d5b00b43-fb6d-4cd4-8b56-6df49f3548fd admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:33.683634 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-d5b00b43-fb6d-4cd4-8b56-6df49f3548fd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013941 May 24 10:08:33.684214 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Tue May 24 10:08:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:33.696697 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-eeb52bfc-f363-49e7-a138-d8000bdcf47e admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:33.704849 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-eeb52bfc-f363-49e7-a138-d8000bdcf47e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011893 May 24 10:08:33.705464 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Tue May 24 10:08:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:33.716894 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:33.724391 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011399 May 24 10:08:33.724910 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Tue May 24 10:08:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:08:33.737599 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-144da967-6614-4b8e-946d-9513b077e364 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:08:33.745095 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-144da967-6614-4b8e-946d-9513b077e364 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011562 May 24 10:08:33.745597 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Tue May 24 10:08:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:12:13.006061 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:13.007076 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 24 10:12:13.007478 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:12:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:12:13.162821 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=6 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:13.278993 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-de321f52-71f2-408b-a270-d98e390cb64b admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:13.280206 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:12:13.280206 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: warnings.warn(msg) May 24 10:12:13.281404 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-de321f52-71f2-408b-a270-d98e390cb64b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:13.281873 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-de321f52-71f2-408b-a270-d98e390cb64b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:13.282651 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-de321f52-71f2-408b-a270-d98e390cb64b admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:13.283078 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-de321f52-71f2-408b-a270-d98e390cb64b admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:13.316595 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-de321f52-71f2-408b-a270-d98e390cb64b admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155380 May 24 10:12:13.317150 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Tue May 24 10:12:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:12:14.188270 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:14.189277 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 24 10:12:14.189680 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:12:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:12:14.382316 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-22ede564-465a-43a9-8fe4-06f9d34fbcfc admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:14.383049 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:12:14.383049 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: warnings.warn(msg) May 24 10:12:14.384268 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-22ede564-465a-43a9-8fe4-06f9d34fbcfc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:14.384704 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-22ede564-465a-43a9-8fe4-06f9d34fbcfc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:14.385480 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-22ede564-465a-43a9-8fe4-06f9d34fbcfc admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:14.385937 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-22ede564-465a-43a9-8fe4-06f9d34fbcfc admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:14.406242 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-22ede564-465a-43a9-8fe4-06f9d34fbcfc admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.072979 May 24 10:12:14.406728 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Tue May 24 10:12:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:12:25.678978 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:25.680024 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 24 10:12:25.680428 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:12:25.821238 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell0:SELECT=4 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:25.821972 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_cell1:SELECT=4 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:25.822589 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG dbcounter [-] [103654] Writing DB stats nova_api:SELECT=8 {{(pid=103654) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:12:25.871726 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-a9c3aeb4-250b-4922-a757-b9860b6c4f6c admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:25.873742 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:12:25.873742 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: warnings.warn(msg) May 24 10:12:25.880737 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a9c3aeb4-250b-4922-a757-b9860b6c4f6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:25.880737 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a9c3aeb4-250b-4922-a757-b9860b6c4f6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:25.880737 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a9c3aeb4-250b-4922-a757-b9860b6c4f6c admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:25.880737 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-a9c3aeb4-250b-4922-a757-b9860b6c4f6c admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:25.901905 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-a9c3aeb4-250b-4922-a757-b9860b6c4f6c admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085026 May 24 10:12:25.902477 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Tue May 24 10:12:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:12:26.766292 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: DEBUG nova.api.openstack.wsgi [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] Calling method '>' {{(pid=103655) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:26.767299 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: INFO nova.api.openstack.requestlog [None req-a5210242-42ca-4266-be24-d327d825328c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 24 10:12:26.767698 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: [pid: 103655|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Tue May 24 10:12:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:12:26.957509 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG nova.api.openstack.wsgi [None req-aeda4c8c-ba77-447c-8d97-c2dfc2a58c50 admin admin] Calling method '>' {{(pid=103654) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:12:26.958674 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 24 10:12:26.958674 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: warnings.warn(msg) May 24 10:12:26.959887 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-aeda4c8c-ba77-447c-8d97-c2dfc2a58c50 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:26.960330 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-aeda4c8c-ba77-447c-8d97-c2dfc2a58c50 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:26.961139 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-aeda4c8c-ba77-447c-8d97-c2dfc2a58c50 admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:12:26.961592 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: DEBUG oslo_concurrency.lockutils [None req-aeda4c8c-ba77-447c-8d97-c2dfc2a58c50 admin admin] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103654) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:12:26.983511 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: INFO nova.api.openstack.requestlog [None req-aeda4c8c-ba77-447c-8d97-c2dfc2a58c50 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078253 May 24 10:12:26.984022 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: [pid: 103654|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Tue May 24 10:12:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:13:24.808097 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: Tue May 24 10:13:24 2022 - graceful shutdown triggered... May 24 10:13:24.807828 dv-cinder-810457-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 24 10:13:24.809086 dv-cinder-810457-9-iscsi devstack@n-api.service[103654]: Gracefully killing worker 1 (pid: 103654)... May 24 10:13:24.809490 dv-cinder-810457-9-iscsi devstack@n-api.service[103655]: Gracefully killing worker 2 (pid: 103655)... May 24 10:13:25.807981 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: worker 1 buried after 1 seconds May 24 10:13:25.807981 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: worker 2 buried after 1 seconds May 24 10:13:25.807981 dv-cinder-810457-9-iscsi devstack@n-api.service[103653]: goodbye to uWSGI. May 24 10:13:25.809507 dv-cinder-810457-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 24 10:13:25.810075 dv-cinder-810457-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 24 10:13:25.812809 dv-cinder-810457-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 24 10:13:25.830700 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 24 10:13:25 2022] *** May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: nodename: dv-cinder-810457-9-iscsi May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: machine: x86_64 May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: clock source: unix May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: pcre jit disabled May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: detected number of CPU cores: 4 May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: current working directory: / May 24 10:13:25.840193 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: detected binary path: /usr/bin/uwsgi-core May 24 10:13:25.840988 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: your processes number limit is 47680 May 24 10:13:25.840988 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: your memory page size is 4096 bytes May 24 10:13:25.840988 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: detected max file descriptor number: 2048 May 24 10:13:25.840988 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: lock engine: pthread robust mutexes May 24 10:13:25.840988 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: thunder lock: enabled May 24 10:13:25.840988 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 24 10:13:25.840988 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 24 10:13:25.886273 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: Python main interpreter initialized at 0x55e182c039c0 May 24 10:13:25.886273 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: python threads support enabled May 24 10:13:25.886273 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: your server socket listen backlog is limited to 100 connections May 24 10:13:25.886273 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: your mercy for graceful operations on workers is 90 seconds May 24 10:13:25.886727 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: mapped 403077 bytes (393 KB) for 2 cores May 24 10:13:25.886727 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: *** Operational MODE: preforking *** May 24 10:13:25.886947 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: *** uWSGI is running in multiple interpreter mode *** May 24 10:13:25.886947 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: spawned uWSGI master process (pid: 118109) May 24 10:13:25.887151 dv-cinder-810457-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 24 10:13:25.887767 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: spawned uWSGI worker 1 (pid: 118130, cores: 1) May 24 10:13:25.888306 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: spawned uWSGI worker 2 (pid: 118131, cores: 1) May 24 10:13:25.888599 dv-cinder-810457-9-iscsi devstack@n-api.service[118109]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 24 10:13:27.079893 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 10:13:27.081269 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 24 10:13:27.867572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:13:27.867572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: from cryptography.utils import int_from_bytes May 24 10:13:27.867934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:13:27.867934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: from cryptography.utils import int_from_bytes May 24 10:13:27.868870 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:13:27.868870 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: from cryptography.utils import int_from_bytes May 24 10:13:27.869221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 24 10:13:27.869221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: from cryptography.utils import int_from_bytes May 24 10:13:30.338164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 10:13:30.338730 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 10:13:30.338843 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 24 10:13:30.339221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 10:13:30.339310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 24 10:13:30.339396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 10:13:30.339751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 10:13:30.346371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 24 10:13:30.346371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 24 10:13:30.346594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.346674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 24 10:13:30.346768 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.346852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.346933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.346933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.347085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.347185 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.347296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.347385 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.347468 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.347573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.347654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.349622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.349717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.349803 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.349888 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350022 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350236 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350402 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-9-iscsi {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350552 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350637 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350768 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.350943 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-810457-9-iscsi {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351701 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.351999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352341 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352499 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352602 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352678 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352777 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.352933 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353091 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353171 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353333 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353631 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353706 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-9-iscsi {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353867 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.353941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354029 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-810457-9-iscsi {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354110 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354184 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354337 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354427 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354502 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354581 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354669 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354750 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354831 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.354994 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355266 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355359 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355446 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355526 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355680 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.355786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356320 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356405 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356480 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356636 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356799 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.356969 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357233 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357321 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357411 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357773 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357886 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.357974 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358067 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358162 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358362 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358362 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.358955 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359052 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359621 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.359834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.361785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.361895 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.361991 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362077 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362162 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362237 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362310 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362464 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362767 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.362927 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363101 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363184 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363264 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363352 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363432 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363530 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363715 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.363839 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.369713 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.369822 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.369900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.369986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.370070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.370166 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.370390 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.370477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.370562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.370640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.370713 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371166 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371263 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371347 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371507 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371587 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.371987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372086 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372243 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372316 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372397 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372480 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372571 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372719 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372800 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.372926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.374305 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.374409 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.374494 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.374584 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.374678 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.374771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.374869 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375005 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375302 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375595 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375683 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375787 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.375940 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.377786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.377868 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.377953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378117 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378312 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378516 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378604 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378718 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.378960 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.379750 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.380819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.380944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.381349 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.381462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.381553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.381640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.381726 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.381812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.381898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382006 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382096 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382191 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382282 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382376 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382470 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382470 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382652 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382741 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.382921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383108 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383196 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383280 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383466 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383562 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383656 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.383937 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384039 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384145 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384241 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384518 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384602 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384697 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384792 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384886 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.384983 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385248 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385515 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385600 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385699 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385836 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.385924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.386016 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.386104 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.386190 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.386292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.386380 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.386465 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.386551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 24 10:13:30.386639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.386726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.386820 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.386915 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387104 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387191 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387380 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387474 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387746 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.387942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388044 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388140 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388330 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388793 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.388964 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389063 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389163 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389524 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389524 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389705 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389804 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389902 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.389997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390091 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390449 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390535 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390629 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390730 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390911 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.390997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.391089 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.391200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.391200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.391670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.391865 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392252 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392351 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392541 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392629 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392829 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.392980 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.393119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.393319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.393420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.393596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.393716 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.393906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.394024 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.394211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.394305 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.394519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.394630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.394852 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.394956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.395164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.395266 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.395473 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.395579 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.395782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.395900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.396115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.396220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.396423 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.396527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.396731 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.396829 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.397038 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.397135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.397340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.397438 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.397642 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.397745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.397944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.398047 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.398250 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.398354 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.398550 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.398646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.398855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.398948 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.399161 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.399257 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.399468 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.399571 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.399784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.400051 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.400164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.400262 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.400414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.400510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.400720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.400827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.401029 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.401125 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.401333 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.401657 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.401756 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.401859 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.401990 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.402097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.402224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.402321 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.402541 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.402650 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.402847 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.402940 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.403151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.403254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.403460 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.403564 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.403761 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.403876 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.404087 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.404192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.404399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.404491 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.404705 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.404808 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.405012 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.405113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.405321 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.405428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.405623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.405725 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.405940 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.406047 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.406251 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.406353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.406559 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.406661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.406868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.406970 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.407234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.407395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.407571 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.407771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.408565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.408671 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.408769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.408866 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.408962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409143 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409602 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.409887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.410062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.410182 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.410368 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.410484 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.410679 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.410818 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.410985 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.411099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.411286 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.411397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.411590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.411708 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.411923 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.412065 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.412231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.412388 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.412536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.412672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.412830 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.412977 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.413116 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.413249 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.413421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.413569 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.413745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.413891 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.414057 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.414187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.414364 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.414509 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.414671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.414821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.414978 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.415128 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.415324 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.415465 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.415631 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.415770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.415973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.416129 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.416266 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.416389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.416581 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.416721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.416891 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.417032 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.417202 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.417342 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.417521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.417672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.417816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.417961 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.418125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.418268 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.418430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.418569 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.418748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.418913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.419044 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.419185 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.419360 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.419500 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.419648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.419784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.419985 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.420135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.420321 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.420461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.420635 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.420784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.420951 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.421088 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.421256 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.421393 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.421567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.421905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.422033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.422157 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.422293 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.422427 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.422572 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.423228 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.423432 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.423649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.423649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.424168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.424304 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.424439 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.424573 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.424705 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.424840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.424989 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.425133 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.425269 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.425402 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.425536 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.425659 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.425809 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.425953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.426096 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.426230 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.426364 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.426486 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.426632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.426769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.426903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.427037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.427171 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.427315 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.427457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.427604 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.427749 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.427924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.428064 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.428256 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.428397 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.428590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.428730 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.428903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.429050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.429219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.429351 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.431837 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.431958 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432276 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432360 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432434 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432507 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432743 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432899 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.432980 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433055 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433212 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433285 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433357 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433524 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433619 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433709 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.433956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434031 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434321 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434407 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434482 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434563 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434818 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.434956 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.435038 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.435153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.435251 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.435459 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.435565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.435764 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.435891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.436132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.436242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.436436 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.436548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.436738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.436842 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.437040 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.437143 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.437346 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.437442 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.437649 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.437790 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.437964 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.438067 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.438270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.438421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.439168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.439332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.439488 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.439592 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.439832 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.439954 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.440131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.440237 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.440443 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.440548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.440757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.440861 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.441067 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.441236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.441380 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.441467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.441701 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.441801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.442008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.442153 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.442315 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.442412 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.442626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.442712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.442928 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.443013 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.443238 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.443330 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.443549 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.443632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.443881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.444169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.444270 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.444494 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.444589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.444806 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.444911 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.445124 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.445227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.445597 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.445707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.445826 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.446026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.446159 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.446338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.446454 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.446659 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.446765 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.446982 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.447087 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.447288 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.447391 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.447593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.447689 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.447922 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.448016 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.448605 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.448686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.448762 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.448860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.448946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449028 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449112 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449188 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449415 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.449999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.450103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.450301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.450410 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.450608 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.450703 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.450921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.451070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.451224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.451328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.451533 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.451636 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.451854 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.451953 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.452165 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.452263 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.452469 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.452563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.452771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.452874 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.453071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.453168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.453374 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.453470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.453695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.453815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.454027 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.454160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.454497 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.454613 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.455048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.455411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.455651 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.455786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.455988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.456109 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.456297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.456434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.456624 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.456745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.456931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.457049 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.457233 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.457350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.457533 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.457642 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.457840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.457942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.458147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.458266 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.458445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.458549 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.458755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.458852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.459061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.459168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.459368 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.459472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.459675 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.459772 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.460002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.460110 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.460307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.460402 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.460612 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.460709 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.460924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.461024 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.461232 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.461328 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.461532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.461640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.461833 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.461936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.462136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.462238 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.462441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.462546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.462742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.462838 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.463045 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.463138 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.463346 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.463487 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.463656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.463750 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.463981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.464085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.464283 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.464388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.464584 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.464681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.464888 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.464989 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.465193 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.465287 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.465494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.465591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.465798 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.465904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.466100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.466199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.466401 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.466514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.466704 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.466820 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.467006 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.467146 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.467301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.467403 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.467601 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.467698 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.467931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.468031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.468250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.468354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.468560 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.468655 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.468859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.468956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.469162 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.469255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.469461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.469588 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.469857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.469947 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.470196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.470317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.470505 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.470706 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.470813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.471022 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.471119 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.471332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.471430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.471640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.471744 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.471971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.472068 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.472285 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.472396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.472588 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.472682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.472890 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.472993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.473193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.473296 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.473493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.473588 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.473812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.473916 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.474120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.474225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.474430 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.474533 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.474736 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.474836 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.475044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.475139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.475349 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.475456 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.475660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.475755 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.475985 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.476103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.476292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.476397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.476594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.476690 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.476907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.477004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.477219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.477316 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.477529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.477623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.477832 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.477932 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.478133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.478240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.478448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.478544 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.478758 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.478853 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.479068 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.479172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.479381 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.479475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.479687 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.479792 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.480018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.480127 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.480321 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.480435 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.480634 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.480729 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.480943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.481038 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.481249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.481354 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.481555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.481650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.481860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.481955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.482167 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.482293 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.482481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.482601 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.482789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.482906 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.483113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.483223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.483400 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.483503 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.483702 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.483939 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.484046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.484136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.484330 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.484428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.484635 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.484730 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.484945 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.485071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.485791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.485902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.486162 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.486269 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.486470 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.486564 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.486776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.486870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.487085 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.487179 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.487389 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.487493 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.487775 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.487931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.488103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.488218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.488414 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.488511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.488722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.488819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.489029 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.489134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.489334 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.489435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.489644 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.489764 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.489957 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.490065 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.490259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.490378 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.490673 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.490769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.490984 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.491089 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.491296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.491391 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.491601 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.491697 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.491936 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.492035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.492240 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.492346 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.492547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.492651 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.492869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.492966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.493169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.493274 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.493471 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.493566 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.493772 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.493877 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.494092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.494202 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.494394 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.494497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.494713 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.494811 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.495029 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.495132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.495335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.495440 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.495642 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.495745 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.495990 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.496136 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.496298 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.496447 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.496623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.496754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.497041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.497143 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.497353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.497463 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.497661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.497765 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.497981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.498085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.498292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.498397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.498600 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.498704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.498920 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.499025 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.499239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.499343 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.499547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.499692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.499882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.500064 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.500181 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.500315 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.500493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.500627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.500829 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.500961 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.501197 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.501295 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.501512 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.501618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.501828 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.502033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.502138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.502360 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.502464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.502670 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.502777 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.502991 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.503088 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.503314 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.503401 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.503617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.503763 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.503946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.504113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.504256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.504426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.504560 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.504748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.504855 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.505073 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.505170 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.505379 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.505495 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.505689 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.505830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.506002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.506102 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.506306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.506421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.506612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.506723 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.507348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.507472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.507472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.507654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.507753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.507880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.507971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.508060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.508161 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.508259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.508442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.508548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.508748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.508852 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.509061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.509158 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.509366 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.509461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.509674 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.509820 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.509977 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.510083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.510279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.510376 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.510582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.510724 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.510906 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.511015 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.511222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.511318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.511530 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.511635 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.511858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.511962 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.512166 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.512261 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.512472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.512580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.512805 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.512901 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.513111 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.513206 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.513433 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.513538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.513747 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.513850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.514072 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.514176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.514376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.514481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.514677 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.514774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.514986 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.515082 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.515292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.515396 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.515597 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.515694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.515925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.516024 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.516237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.516381 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.517083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.517177 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.517399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.517540 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.517717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.517859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.518008 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.518149 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.518314 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.518456 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.518627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.518780 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.518933 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.519090 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.519240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.519396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.519546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.519702 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.519897 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.520032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.520209 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.520375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.520536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.520682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.520849 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.521015 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.521163 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.521336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.521472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.521661 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.521765 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.522045 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.522142 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.522359 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.522456 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.522681 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.522786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.523002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.523108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.523318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.523422 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.523632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.523737 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.523974 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.524086 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.524292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.524389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.524610 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.524707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.524924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.525029 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.525234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.525331 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.525549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.525700 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.525863 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.525974 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.526179 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.526275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.526501 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.526713 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.526858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.527042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.527137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.527357 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.527454 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.527670 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.527775 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.528008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.528266 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.528371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.528600 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.528697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.528914 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.529011 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.529222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.529317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.529529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.529625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.529836 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.529943 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.530148 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.530247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.530462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.530570 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.530775 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.530874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.531092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.531187 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.531403 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.531514 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.531720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.531846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.532076 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.532244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.532441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.532625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.532796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.532972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.533111 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.533294 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.533401 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.533614 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.533725 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.533930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.534028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.534247 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.534354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.534607 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.534705 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.534913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.535009 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.535221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.535324 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.535529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.535623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.535859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.535960 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.536169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.536267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.536481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.536590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.536794 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.536921 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.537102 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.537206 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.537416 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.537521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.537729 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.537840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.538039 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.538135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.538351 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.538455 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.538663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.538769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.538988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.539176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.539326 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.539490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.539648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.539842 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.540002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.540169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.540320 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.540492 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.540637 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.540807 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.541122 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.541218 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.541445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.541541 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.541755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.541853 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.542060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.542164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.542370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.542473 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.542678 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.542776 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.542979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.543075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.543297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.543404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.543603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.543700 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.543930 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.544043 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.544245 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.544350 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.544550 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.544653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.544854 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.545080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.545185 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.545426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.545529 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.545738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.545843 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.546061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.546167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.546372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.546476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.546684 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.546909 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.547008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.547263 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.547404 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.547583 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.547680 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.548424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.548574 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.548736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.548835 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.549046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.549151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.549348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.549446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.549649 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.549755 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.549955 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.550059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.550259 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.550407 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.550557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.550653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.550864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.550959 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.551165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.551277 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.551473 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.551570 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.551776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.551953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.552104 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.552217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.552406 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.552501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.552711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.552806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.553017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.553121 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.553316 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.553410 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.553616 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.553712 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.553916 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.554020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.554222 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.554344 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.554520 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.554642 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.554825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.554930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.555126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.555230 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.555429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.555525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.555728 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.555844 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.556063 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.556166 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.556370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.556473 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.556682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.556836 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.556972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.557107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.557287 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.557384 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.557594 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.557694 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.557899 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.558002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.558219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.558329 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.558530 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.558683 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.558837 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.558941 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.559150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.559330 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.559470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.559575 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.559784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.560021 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.560135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.560352 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.560494 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.560668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.560801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.560997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.561108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.561325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.561434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.561628 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.561896 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.561993 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.562228 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.562332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.562551 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.562656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.562860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.562965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.563168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.563265 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.563547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.563652 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.563878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.564141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.564252 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.564350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.564485 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.564591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.564792 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.564889 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.565100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.565198 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.565406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.565503 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.565711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.565817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.566017 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.566121 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.566323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.566435 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.566633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.566739 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.566947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.567045 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.567261 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.567369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.567571 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.567711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.567906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.568004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.568217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.568315 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.568524 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.568629 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.568833 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.568932 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.569142 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.569239 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.569449 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.569546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.569761 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.569857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.570085 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.570190 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.570397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.570494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.570698 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.570804 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.571010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.571148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.571323 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.571420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.571647 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.571752 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.572005 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.572120 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.572324 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.572428 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.572634 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.572732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.572952 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.573058 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.573262 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.573359 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.573580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.573678 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.573888 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.573987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.574213 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.574311 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.574552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.574656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.574879 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.574986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.575198 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.575293 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.575500 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.575597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.575823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.575924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.576126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.576230 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.576432 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.576543 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.576749 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.576860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.577058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.577162 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.577361 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.577470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.577665 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.577805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.577973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.578071 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.578277 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.578388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.578580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.578685 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.578882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.579519 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.579732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.579960 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.580059 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.580498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.580647 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.580815 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.580922 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.581127 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.581275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.581438 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.581546 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.581747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.581853 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.582046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.582149 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.582350 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.582446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.582653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.582763 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.582953 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.583050 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.583253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.583357 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.583554 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.583661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.583925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.584030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.584183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.584286 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.584496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.584608 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.584803 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.584908 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.585111 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.585209 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.585417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.585522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.585722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.585817 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.586027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.586123 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.586342 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.586439 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.586660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.586757 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.586974 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.587071 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.587281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.587427 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.587606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.587710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.587936 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.588045 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.588248 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.588348 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.588557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.588654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.588864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.589039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.589173 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.589279 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.589480 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.589576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.589803 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.589914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.590115 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.590211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.590421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.590524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.590733 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.590875 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.591045 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.591194 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.591356 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.591454 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.591668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.591764 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.592001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.592099 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.592331 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.592429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.592638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.592734 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.592942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.593051 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.593255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.593366 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.593562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.593668 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.593874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.593970 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.594188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.594296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.594504 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.594665 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.594878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.595051 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.595192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.595447 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.595560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.595764 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.595923 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.596116 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.596213 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.596438 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.596534 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.596759 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.596857 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.597081 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.597186 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.597411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.597564 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.597727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.597825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.598037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.598151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.598347 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.598446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.598651 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.598748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.598892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 10:13:30.599000 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.599348 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.599681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.600027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.600345 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.600655 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 24 10:13:30.600901 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 24 10:13:30.657864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO dbcounter [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Registered counter for database nova_api May 24 10:13:30.659869 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Registered counter for database nova_api May 24 10:13:30.677883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.679359 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.686102 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writer thread running {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:30.693619 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:30.743676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.context [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7fc9cc-559b-4c6a-9445-47ad843e2912(cell1) {{(pid=118130) load_cells /opt/stack/nova/nova/context.py:464}} May 24 10:13:30.747848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:13:30.749433 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:13:30.750174 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.context [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a7fc9cc-559b-4c6a-9445-47ad843e2912(cell1) {{(pid=118131) load_cells /opt/stack/nova/nova/context.py:464}} May 24 10:13:30.750317 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:13:30.753098 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:13:30.754922 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:13:30.755100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO dbcounter [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Registered counter for database nova_cell0 May 24 10:13:30.756542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:13:30.757358 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:13:30.759246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO dbcounter [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Registered counter for database nova_cell1 May 24 10:13:30.759435 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:13:30.761431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Registered counter for database nova_cell0 May 24 10:13:30.765409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Registered counter for database nova_cell1 May 24 10:13:30.769430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.770233 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.773382 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.777681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.777818 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writer thread running {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:30.778150 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writer thread running {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:30.779179 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:30.925782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:30.926385 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO dbcounter [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Registered counter for database nova_cell0 May 24 10:13:30.935164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO dbcounter [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Registered counter for database nova_cell0 May 24 10:13:30.935460 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.942524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_db.sqlalchemy.engines [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 24 10:13:30.943834 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writer thread running {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:30.947074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writer thread running {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 24 10:13:31.268653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:13:31.275892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:13:31.286959 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: WARNING keystonemiddleware.auth_token [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:13:31.294731 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: WARNING keystonemiddleware.auth_token [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:13:31.625327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:13:31.631908 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: WARNING keystonemiddleware.auth_token [None req-2d3254f6-0923-45c2-9189-d622bab4c2d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:13:31.637106 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e182c039c0 pid: 118131 (default app) May 24 10:13:31.647991 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: WARNING keystonemiddleware.auth_token [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 24 10:13:31.653918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: WARNING keystonemiddleware.auth_token [None req-c7fb6699-57c2-4bef-95f0-e67c05141d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 24 10:13:31.659351 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e182c039c0 pid: 118130 (default app) May 24 10:14:14.763257 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:14.771943 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:14.773041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:14.774076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:16.408347 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f002820a-daa0-44e8-aef3-f2d2e244234c tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Action: 'create', calling method: .version_select at 0x7ff640f8ac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1082089473", "metadata": {"Type": "work"}}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:18.014070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=3 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:18.014070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=3 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:18.014070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=3 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:18.014070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=3 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:18.341871 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1274559923", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "networks": [{"uuid": "e5b97653-9cfa-4371-945b-db1f8d800ce8"}]}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:18.846700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] validate_networks() for [('e5b97653-9cfa-4371-945b-db1f8d800ce8', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:14:19.571898 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f002820a-daa0-44e8-aef3-f2d2e244234c tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.822659 May 24 10:14:19.575187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Tue May 24 10:14:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4828 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 10:14:19.587569 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-34782a6e-3146-441b-b63f-237d2d794d52 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Calling method '.version_select at 0x7ff640dd4b80>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:19.753084 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-34782a6e-3146-441b-b63f-237d2d794d52 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200" status: 200 len: 353 microversion: 2.1 time: 0.169598 May 24 10:14:19.753916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 2/2] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:14:19 2022] GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200 => generated 353 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:20.766756 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8a49be53-1a59-4941-89bb-f79923018540 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Calling method '.version_select at 0x7ff640dd4dc0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:20.850979 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8a49be53-1a59-4941-89bb-f79923018540 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200" status: 200 len: 354 microversion: 2.1 time: 0.086481 May 24 10:14:20.859704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 3/3] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:14:20 2022] GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200 => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:20.873085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ddb30cd4-bec4-45ce-b150-6331bd0b49a8 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Calling method '.version_select at 0x7ff640df0310>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:20.971432 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ddb30cd4-bec4-45ce-b150-6331bd0b49a8 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200" status: 200 len: 354 microversion: 2.1 time: 0.109848 May 24 10:14:20.972159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 4/4] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:14:20 2022] GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:20.989247 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4262e7a9-4c04-40ec-8cd1-ac5c323f7db2 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Calling method '.version_select at 0x7ff640df0a60>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:21.084821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:14:21.084821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:14:21.084821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:14:21.084821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:14:21.085511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:14:21.107172 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:21.107781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:21.109018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:21.109709 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:21.149294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Getting quotas for project 1aeb238c6f4b4c67b876c966b62d3e86. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:14:21.157073 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Getting quotas for user 663b8de7a75342e28e9d2061efad8305 and project 1aeb238c6f4b4c67b876c966b62d3e86. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:14:21.171414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:14:21.178999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:14:21.244749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4262e7a9-4c04-40ec-8cd1-ac5c323f7db2 tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200" status: 202 len: 0 microversion: 2.1 time: 0.259250 May 24 10:14:21.245771 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 5/5] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:14:20 2022] DELETE /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:14:21.420784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-addee887-fc26-413a-b617-d39fc8324762 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.613864 May 24 10:14:21.422224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 1/6] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:14:21.428567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3950df89-2934-4e8a-882e-6d57d051939d tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Calling method '.version_select at 0x7ff640d81c10>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:21.490206 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-940346359", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:21.625010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3950df89-2934-4e8a-882e-6d57d051939d tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200" status: 200 len: 353 microversion: 2.1 time: 0.201103 May 24 10:14:21.626490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 2/7] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:14:21 2022] GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200 => generated 353 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:21.635060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fa860bf3-8860-4f8f-b28d-89d90852ae82 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:21.636063 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fa860bf3-8860-4f8f-b28d-89d90852ae82 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:21.720181 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] validate_networks() for [('8587c97f-8883-4d0e-9495-da500acecb33', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:14:21.888557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fa860bf3-8860-4f8f-b28d-89d90852ae82 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:21.914438 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fa860bf3-8860-4f8f-b28d-89d90852ae82 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1215 microversion: 2.1 time: 0.286370 May 24 10:14:21.917208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 3/8] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:21 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1215 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:22.639088 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4e6f5576-60d2-4dbb-b73a-95c59bbaf47a tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Calling method '.version_select at 0x7ff64051c1f0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:22.696632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-4e6f5576-60d2-4dbb-b73a-95c59bbaf47a tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] HTTP exception thrown: Volume 9a4dd2e7-b5f0-40ef-bf07-8d524487f200 could not be found. May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4e6f5576-60d2-4dbb-b73a-95c59bbaf47a tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Request method failure captured: May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200 HTTP/1.1 May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_2MX2czD9sneNDgGXdpAufiV_3BII8tWZywQx0-eJ1APx07n4ZyxFW1ytXEa01Hm6bc9hAcij1TKjcFUQUoWjuSWS0wBzj35TlTNXpxmPPRgQj-R73viWsNHC5QMAXfvg5gfUwwZfoidQx0zCw7X2WVpy9i0TN2fIZrCAEOGt_c64 May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 117092c933ec4467ac0ad7f900e675fd May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesGetTestJSON-2122901621 May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:14:22.700982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/117092c933ec4467ac0ad7f900e675fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/117092c933ec4467ac0ad7f900e675fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_117092c933ec4467ac0ad7f900e675fd", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/117092c933ec4467ac0ad7f900e675fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesGetTestJSON-2122901621 May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 117092c933ec4467ac0ad7f900e675fd May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesGetTestJSON-2122901621 May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesGetTestJSON-2122901621-project May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: af64ffaa4eab4c03aaa0693178538994 May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesGetTestJSON-2122901621-project May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Volume 9a4dd2e7-b5f0-40ef-bf07-8d524487f200 could not be found. May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '9a4dd2e7-b5f0-40ef-bf07-8d524487f200'} May 24 10:14:22.702260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9a4dd2e7-b5f0-40ef-bf07-8d524487f200 could not be found. (HTTP 404) (Request-ID: req-ab5b317e-11c8-42f6-8506-1994d850a756) May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:14:22.703494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:14:22.704507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9a4dd2e7-b5f0-40ef-bf07-8d524487f200 could not be found. May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 10:14:22.705784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9a4dd2e7-b5f0-40ef-bf07-8d524487f200 could not be found. May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9a4dd2e7-b5f0-40ef-bf07-8d524487f200 could not be found. May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4e6f5576-60d2-4dbb-b73a-95c59bbaf47a tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] Returning 404 to user: Volume 9a4dd2e7-b5f0-40ef-bf07-8d524487f200 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:14:22.706864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4e6f5576-60d2-4dbb-b73a-95c59bbaf47a tempest-VolumesGetTestJSON-2122901621 tempest-VolumesGetTestJSON-2122901621-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200" status: 404 len: 109 microversion: 2.1 time: 0.068700 May 24 10:14:22.707556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 4/9] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:14:22 2022] GET /compute/v2.1/os-volumes/9a4dd2e7-b5f0-40ef-bf07-8d524487f200 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:14:22.934902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1ee028e2-5dfc-4c49-9366-bdddf8fb5f58 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:22.935654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1ee028e2-5dfc-4c49-9366-bdddf8fb5f58 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:23.041103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1ee028e2-5dfc-4c49-9366-bdddf8fb5f58 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:23.059639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1ee028e2-5dfc-4c49-9366-bdddf8fb5f58 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1215 microversion: 2.1 time: 0.123967 May 24 10:14:23.060513 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 5/10] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:22 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:23.633150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:14:23.634273 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:14:23.634969 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:14:23.635621 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:14:23.645702 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:14:23.690079 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:23.690982 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:23.692624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:23.724397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:23.765791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for project 544ebc06855b4435b767c0cc885ec068. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:14:23.774372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for user 04058cb7cf374eba92fb7ee796084e20 and project 544ebc06855b4435b767c0cc885ec068. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:14:23.791026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:14:23.795218 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:14:24.080997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e6324c4f-47a6-44dd-a7e3-d769a8da4193 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:24.082423 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e6324c4f-47a6-44dd-a7e3-d769a8da4193 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:24.106396 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-67a188f4-66c0-48e7-b51c-c6e8a034119d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.847520 May 24 10:14:24.112995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 6/11] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:14:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:14:24.150046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d51681a9-a082-46ed-a80d-ae5ad5531980 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:24.153187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d51681a9-a082-46ed-a80d-ae5ad5531980 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:24.363113 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e6324c4f-47a6-44dd-a7e3-d769a8da4193 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:24.397604 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e6324c4f-47a6-44dd-a7e3-d769a8da4193 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1215 microversion: 2.1 time: 0.323651 May 24 10:14:24.401067 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:24 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1215 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:24.413447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d51681a9-a082-46ed-a80d-ae5ad5531980 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:24.465482 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d51681a9-a082-46ed-a80d-ae5ad5531980 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1221 microversion: 2.1 time: 0.349652 May 24 10:14:24.473718 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:24 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1221 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:24.730965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2063149891", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:24.798943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] validate_networks() for [('8587c97f-8883-4d0e-9495-da500acecb33', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:14:25.418650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:25.420158 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:25.449651 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:25.450301 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:25.451223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:25.452221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:26.136670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:26.170306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c17fb2d1-f00b-4e21-b187-2a178011a871 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1219 microversion: 2.1 time: 0.750368 May 24 10:14:26.172140 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 8/14] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:25 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1219 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:26.732091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:14:26.732618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:14:26.733012 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:14:26.733417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:14:26.733821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:14:26.752848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:26.753639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:26.756503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:26.760165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:26.846721 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for project 544ebc06855b4435b767c0cc885ec068. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:14:26.866529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for user 04058cb7cf374eba92fb7ee796084e20 and project 544ebc06855b4435b767c0cc885ec068. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:14:26.914531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:14:26.937388 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:14:27.165674 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2b1d41de-e361-448a-850a-0bc9f3ef0355 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.443815 May 24 10:14:27.171501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 7/15] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:14:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:14:27.184976 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ecd5e0cb-d203-42d1-ae33-4ef6753b5e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:27.185662 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ecd5e0cb-d203-42d1-ae33-4ef6753b5e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:27.190225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:27.197192 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:27.304386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:27.308985 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:27.308985 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:27.308985 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:27.586375 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ecd5e0cb-d203-42d1-ae33-4ef6753b5e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:27.597692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ecd5e0cb-d203-42d1-ae33-4ef6753b5e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1222 microversion: 2.1 time: 0.419465 May 24 10:14:27.607479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 9/16] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:27 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1222 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:27.906693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:27.941205 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7454277d-e1a2-45de-8707-044d78a4e589 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1275 microversion: 2.1 time: 0.755692 May 24 10:14:27.950651 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 8/17] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:27 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1275 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:28.642627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-feb80143-caaf-46dd-adb3-5d4ac4d1d26c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:28.643616 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-feb80143-caaf-46dd-adb3-5d4ac4d1d26c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:28.974028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:28.975395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:28.983648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:28.984601 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:28.987256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:28.991061 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-feb80143-caaf-46dd-adb3-5d4ac4d1d26c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:29.000928 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:29.006503 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-feb80143-caaf-46dd-adb3-5d4ac4d1d26c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1222 microversion: 2.1 time: 0.368280 May 24 10:14:29.008113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 10/18] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:28 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1222 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:29.310818 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:29.327606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4b1a17b7-2e90-4d65-a87f-606a41df9ab7 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1273 microversion: 2.1 time: 0.365027 May 24 10:14:29.328956 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 9/19] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:28 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1273 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:30.027773 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:30.029040 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:30.056595 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:30.069769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:30.072810 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:30.073425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:30.355923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:30.357225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:30.383933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:30.385292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:30.392300 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:30.394010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:30.776272 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:30.789464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-04b27483-dbd8-4f11-83b9-ac33a6ef950e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1274 microversion: 2.1 time: 0.763363 May 24 10:14:30.797598 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 11/20] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:30 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1274 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:30.839373 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:30.862529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7437d94a-88a6-4249-bf1c-aa085d070241 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1273 microversion: 2.1 time: 0.504542 May 24 10:14:30.864774 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 10/21] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:30 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1273 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:31.909352 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:31.909352 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:31.909352 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:31.909352 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:31.925131 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:31.925131 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:31.931153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:31.931153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:31.940307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:31.940307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:31.942197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:31.943067 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:32.063875 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:32.075035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7407072a-a52c-4a74-adc8-90ac0736188d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1280 microversion: 2.1 time: 0.269625 May 24 10:14:32.075620 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 12/22] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:31 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:32.185316 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:32.198734 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-495e7d02-399e-48d7-85c2-b25c67f191cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1273 microversion: 2.1 time: 0.318080 May 24 10:14:32.204245 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:31 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1273 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:33.099118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:33.100417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:33.108825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:33.112452 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:33.114129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:33.119022 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:33.261060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-40831523-601d-4e37-bda0-5c726b1d10e5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: .version_select at 0x7ff6403f0c10>, body: {"keypair": {"name": "tempest-keypair-1551060467", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuPhdhRaxMnGT9rbdSZy3ypz23qigf51w3yzGszwZAQapM4Xq6Bd51hoXc+F+DmcFT4qtlcRL2m4vnh92dQNrLpjswO/1foxkM9OWZ6fWHXkm5jMz+DJg7S15MAi0X+3w=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:33.296186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:33.305699 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6eea9c80-e38e-4d58-8953-b80aae46b864 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1280 microversion: 2.1 time: 0.205978 May 24 10:14:33.310427 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 12/24] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:33 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:33.319435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:33.335154 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:33.359633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-40831523-601d-4e37-bda0-5c726b1d10e5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:14:33.363907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:33.370935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:33.371089 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-40831523-601d-4e37-bda0-5c726b1d10e5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:14:33.371210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:33.371210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:33.537317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-40831523-601d-4e37-bda0-5c726b1d10e5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.102511 May 24 10:14:33.537988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 13/25] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:14:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:33.757533 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:33.885289 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:33.925234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c2e331dc-50ab-4d96-92d4-9e2b83a0b4e4 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.611281 May 24 10:14:33.927711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 13/26] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:33 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:34.322817 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:34.323572 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:34.336460 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:34.340738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:34.340738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:34.340738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:34.801061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:34.822742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-19f9ad7c-7797-4760-a626-046815526996 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.503882 May 24 10:14:34.843754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 14/27] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:34 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:34.943018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-75e2ebdd-09e8-439f-8702-50146dfe7231 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'create', calling method: .version_select at 0x7ff6403dca60>, body: {"keypair": {"name": "tempest-keypair-724932619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPusZKKJInnt8EvSMhyhhn0YAwgqzv6yOrhM1AAybILl3E1lMS72tPylDlFCuUwuZvm3QMEK8Oq67Gpos2aEoP8mmSp2i4FOGUf3DzSVe5izkrrRcXOiFpRjwBXupKgyQ=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:34.954520 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:34.955380 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:34.980186 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-75e2ebdd-09e8-439f-8702-50146dfe7231 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:14:34.988596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:34.992023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-75e2ebdd-09e8-439f-8702-50146dfe7231 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for user eec86bb8790745aaaa45b6d9e4d94ca7 and project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:14:34.992779 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:34.993637 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:34.999941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:35.149204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-75e2ebdd-09e8-439f-8702-50146dfe7231 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.515528 May 24 10:14:35.149947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 14/28] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:14:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:35.850899 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:35.851687 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:35.861913 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:35.865899 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:35.872200 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:35.881766 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:36.116720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:36.129769 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b83949b5-ebb4-49ce-9e02-57a353044ee1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 1.187711 May 24 10:14:36.134369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 15/29] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:34 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:36.533024 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:36.555045 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b2699109-8d16-4a56-82f2-558edccd5d1b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.704140 May 24 10:14:36.570936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 15/30] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:35 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:37.156287 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:37.157117 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:37.159438 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=4 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:37.161164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=18 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:37.182033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:37.182033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:37.182033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:37.182033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:37.574865 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:37.575478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:37.591717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:37.593286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:37.594279 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:37.595980 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:38.269156 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:38.279132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c832729d-40e9-40e6-a9c1-bc8a04e65a00 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 1.127056 May 24 10:14:38.279132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 16/31] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:37 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:38.412208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:38.436466 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c0a23442-65b0-42a6-86b8-69294096054a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.857583 May 24 10:14:38.445246 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 16/32] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:37 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:39.301017 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:39.302196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:39.322403 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:39.323099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:39.324157 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:39.326071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:39.452674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:39.454799 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:39.475707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:39.481438 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:39.482408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:39.490721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:40.611070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:40.636470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8200daf0-2dde-4fcf-9295-521999ec307e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 1.183143 May 24 10:14:40.637128 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 17/33] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:39 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:40.674056 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:40.692855 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-328c4ded-4d70-4fdb-821e-b52b7eb954c8 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 1.395340 May 24 10:14:40.696552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 17/34] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:39 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:41.011725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-bfb6bb7d-f91a-409f-a08f-767daaa0f538 req-5d788941-4c0b-479f-b5af-5d6d9f25d1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee5360b6-0f14-4294-b939-f78a1edf56e5", "tag": "9226c32d-cef5-4afb-bbe7-9569cc180068"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:41.087623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bfb6bb7d-f91a-409f-a08f-767daaa0f538 req-5d788941-4c0b-479f-b5af-5d6d9f25d1c3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.088144 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bfb6bb7d-f91a-409f-a08f-767daaa0f538 req-5d788941-4c0b-479f-b5af-5d6d9f25d1c3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.178902 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-bfb6bb7d-f91a-409f-a08f-767daaa0f538 req-5d788941-4c0b-479f-b5af-5d6d9f25d1c3 service nova] Creating event network-changed:9226c32d-cef5-4afb-bbe7-9569cc180068 for instance ee5360b6-0f14-4294-b939-f78a1edf56e5 on hv-cinder-81045 May 24 10:14:41.179581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bfb6bb7d-f91a-409f-a08f-767daaa0f538 req-5d788941-4c0b-479f-b5af-5d6d9f25d1c3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118131) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 10:14:41.184934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23f8c40d-0525-45b0-b9ab-c9b6b4ce4653 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.184934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23f8c40d-0525-45b0-b9ab-c9b6b4ce4653 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.184934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23f8c40d-0525-45b0-b9ab-c9b6b4ce4653 None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.184934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23f8c40d-0525-45b0-b9ab-c9b6b4ce4653 None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.206070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.compute.rpcapi [None req-23f8c40d-0525-45b0-b9ab-c9b6b4ce4653 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 10:14:41.253373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-23f8c40d-0525-45b0-b9ab-c9b6b4ce4653 None None] Releasing lock "compute-rpcapi-router" {{(pid=118131) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 10:14:41.316017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-23f8c40d-0525-45b0-b9ab-c9b6b4ce4653 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.677510 May 24 10:14:41.316629 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 18/35] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:41.608558 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-5f4ab31f-33d2-47d7-a4de-2bc157865852 req-cdd8c6f6-eba6-4ddc-ae2c-6e509eea89fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce032c3-2129-40d1-94b5-0c2b5f4aaa68", "tag": "71fb9519-9e7e-466c-8ff2-8f15ff74dc15"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:41.630959 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-5f4ab31f-33d2-47d7-a4de-2bc157865852 req-cdd8c6f6-eba6-4ddc-ae2c-6e509eea89fb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.631550 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-5f4ab31f-33d2-47d7-a4de-2bc157865852 req-cdd8c6f6-eba6-4ddc-ae2c-6e509eea89fb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.654341 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:41.657916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:41.667836 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.669832 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.671033 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.671648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.714758 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-5f4ab31f-33d2-47d7-a4de-2bc157865852 req-cdd8c6f6-eba6-4ddc-ae2c-6e509eea89fb service nova] Creating event network-changed:71fb9519-9e7e-466c-8ff2-8f15ff74dc15 for instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 on hv-cinder-81045 May 24 10:14:41.726137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-5f4ab31f-33d2-47d7-a4de-2bc157865852 req-cdd8c6f6-eba6-4ddc-ae2c-6e509eea89fb service nova] Acquired lock "compute-rpcapi-router" {{(pid=118130) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 24 10:14:41.733238 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca655fd0-5949-4421-90ee-933168003c99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.737326 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca655fd0-5949-4421-90ee-933168003c99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.738504 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca655fd0-5949-4421-90ee-933168003c99 None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.739840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca655fd0-5949-4421-90ee-933168003c99 None None] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.767285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.compute.rpcapi [None req-ca655fd0-5949-4421-90ee-933168003c99 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 24 10:14:41.773366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca655fd0-5949-4421-90ee-933168003c99 None None] Releasing lock "compute-rpcapi-router" {{(pid=118130) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 24 10:14:41.828951 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ca655fd0-5949-4421-90ee-933168003c99 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.323716 May 24 10:14:41.829935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 18/36] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:41.842317 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:41.842317 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:41.854138 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.855424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:41.856614 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:41.860656 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:42.743849 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:42.752847 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0dfab9b9-1df0-4ab0-9ebb-a355b68718a0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 1.102836 May 24 10:14:42.759084 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 19/37] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:41 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:42.834169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:42.843338 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8e952933-0048-4083-abf3-c6f77107ec61 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 1.010070 May 24 10:14:42.844501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 19/38] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:41 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:43.551202 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-6a5587df-6379-4a78-b981-1803288ada2b req-f35e9594-b042-4b86-aed3-ae58b5a7e753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80399184-6140-46b7-9089-6a315714fa4b", "tag": "f74bf4d2-24ef-446e-a89a-89504b608d16"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:43.571531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-565285811", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0108d856-6f4b-41f3-afa6-b1ae3c7d6339"}], "security_groups": [{"name": "tempest-securitygroup--1702110077"}], "key_name": "tempest-keypair-724932619", "user_data": "}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:43.577728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-6a5587df-6379-4a78-b981-1803288ada2b req-f35e9594-b042-4b86-aed3-ae58b5a7e753 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:43.578393 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-6a5587df-6379-4a78-b981-1803288ada2b req-f35e9594-b042-4b86-aed3-ae58b5a7e753 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:43.599904 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-6a5587df-6379-4a78-b981-1803288ada2b req-f35e9594-b042-4b86-aed3-ae58b5a7e753 service nova] Creating event network-changed:f74bf4d2-24ef-446e-a89a-89504b608d16 for instance 80399184-6140-46b7-9089-6a315714fa4b on hv-cinder-81045 May 24 10:14:43.605763 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-6a5587df-6379-4a78-b981-1803288ada2b req-f35e9594-b042-4b86-aed3-ae58b5a7e753 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061020 May 24 10:14:43.608858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 20/39] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:43.752344 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] validate_networks() for [('0108d856-6f4b-41f3-afa6-b1ae3c7d6339', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:14:43.774098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:43.774932 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:43.782078 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:43.782587 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:43.783428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:43.783956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:43.988083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:43.995632 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-41e8eca5-f9aa-4562-8b8d-c22f95a26dab tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.225749 May 24 10:14:43.996220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 21/40] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:43 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:44.009515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:44.010123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:44.016541 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:44.016994 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:44.017758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:44.018389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:44.226231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:44.237266 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f9d33e8f-95de-4aa8-a5ab-a86e54a4428a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.231314 May 24 10:14:44.237950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 22/41] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:44 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:44.243139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1477977877", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b9088f5-9d8c-4699-894a-607b83cfa3db"}], "security_groups": [{"name": "tempest-securitygroup--2062720135"}], "key_name": "tempest-keypair-1551060467", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:44.361647 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:14:44.362101 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:14:44.362526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:14:44.362930 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:14:44.363335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:14:44.373504 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:44.376355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:44.376355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:44.376355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:44.384176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] validate_networks() for [('4b9088f5-9d8c-4699-894a-607b83cfa3db', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:14:44.392929 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:14:44.397149 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for user eec86bb8790745aaaa45b6d9e4d94ca7 and project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:14:44.410136 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:14:44.412518 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:14:44.566867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4ec9a98b-8cc9-4054-96c0-e357d04ad6c8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.000926 May 24 10:14:44.568112 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 20/42] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:14:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:14:44.588141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-28497fe4-677f-4d8b-8268-279b2904e542 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:44.597102 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-28497fe4-677f-4d8b-8268-279b2904e542 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:44.732830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-28497fe4-677f-4d8b-8268-279b2904e542 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:44.739746 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-28497fe4-677f-4d8b-8268-279b2904e542 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1236 microversion: 2.1 time: 0.163579 May 24 10:14:44.740344 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 21/43] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:44 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1236 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:44.978400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:14:44.979658 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:14:44.980948 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:14:44.982065 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:14:44.984222 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:14:44.986653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=5 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:44.992288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=21 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:44.994834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:44.995281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:44.996546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:44.996855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:45.004723 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=63 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:45.012520 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:45.014321 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:45.016587 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:14:45.020927 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:45.021604 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:14:45.028126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:45.028126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:45.028126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:45.034132 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:14:45.037228 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:14:45.272779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d1169269-cd54-4bce-a1cf-e0a84a52f355 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.033087 May 24 10:14:45.275934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:14:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:14:45.309243 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:45.315836 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:45.329991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:45.330460 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:45.331476 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:45.334131 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:45.344428 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:45.352808 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-19176151-4248-4a23-897b-f8517acf06d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.344470 May 24 10:14:45.353395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 22/45] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:45 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:45.371941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f9e8542b-d8a5-4f23-bb55-3c8eded1a86d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:45.371941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f9e8542b-d8a5-4f23-bb55-3c8eded1a86d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:45.481336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f9e8542b-d8a5-4f23-bb55-3c8eded1a86d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:45.489935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f9e8542b-d8a5-4f23-bb55-3c8eded1a86d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1242 microversion: 2.1 time: 0.130865 May 24 10:14:45.492511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 23/46] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:45 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:45.553467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:45.562436 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-88aff20d-647e-4f91-aac9-a6e2d5c10bdd tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.284911 May 24 10:14:45.563591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 24/47] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:45 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:45.770385 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-72d1882b-c3d1-47d7-b7e8-da29c8f6642e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:45.771641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-72d1882b-c3d1-47d7-b7e8-da29c8f6642e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:45.802249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:45.900192 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-72d1882b-c3d1-47d7-b7e8-da29c8f6642e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:45.914284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-72d1882b-c3d1-47d7-b7e8-da29c8f6642e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1236 microversion: 2.1 time: 0.149616 May 24 10:14:45.929848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 24/48] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:45 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1236 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:46.375836 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:46.376736 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:46.387694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:46.389138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:46.390086 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:46.390840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:46.517907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3b58bd43-d9e0-4009-b08b-d4ed6cc4a427 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:46.520108 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3b58bd43-d9e0-4009-b08b-d4ed6cc4a427 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:46.720477 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3b58bd43-d9e0-4009-b08b-d4ed6cc4a427 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:46.739239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3b58bd43-d9e0-4009-b08b-d4ed6cc4a427 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1242 microversion: 2.1 time: 0.233289 May 24 10:14:46.739853 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 25/49] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:46 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1242 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:46.752177 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:46.753860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:46.766848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:46.774329 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:46.776964 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:46.776964 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:47.348298 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:47.356498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-114cc052-2c04-4606-a555-92e698f09ec2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.988986 May 24 10:14:47.366107 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 25/50] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:46 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:47.392436 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:47.393349 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:47.440615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:47.440615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:47.440615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:47.440615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:47.578130 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:47.582734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c378abb3-0bd3-4a63-a5af-85872ac629a6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1288 microversion: 2.1 time: 0.214565 May 24 10:14:47.592384 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 26/51] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:47 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1288 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:47.595733 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:47.614164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-684fe0ed-a36c-4c13-9e95-10d20d540ebc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.869639 May 24 10:14:47.629773 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 26/52] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:46 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:47.772464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:47.775056 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:47.794122 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:47.794928 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:47.796173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:47.796823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:47.872095 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:47.880189 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8a25fd2f-ad46-4e07-8042-2603284cf745 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1246 microversion: 2.1 time: 0.118484 May 24 10:14:47.880963 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 27/53] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:47 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:48.376421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:48.377055 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:48.383589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.384068 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.384844 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.385276 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.602551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:48.604203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:48.611747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.612293 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.613069 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.613507 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.633053 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:48.641582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-260fc0f4-31d8-4014-8063-7186ab1761de tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.270959 May 24 10:14:48.649270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 27/54] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:48 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:48.654736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:48.655498 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:48.661558 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.661997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.662884 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.663340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.694379 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:48.702472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cdb3a2e8-4438-4cf7-9cab-2788067b0ee6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1288 microversion: 2.1 time: 0.104504 May 24 10:14:48.703035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 28/55] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:48 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1288 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:48.798832 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:48.802413 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:48.806713 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-482b5891-d0bc-4e16-8a84-4aac6876bbb6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.156228 May 24 10:14:48.807274 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 28/56] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:48 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:48.896746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:48.903496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:48.903496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.903703 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.904397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:48.904827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:48.968943 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:48.976386 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-11574854-b130-4625-b413-4d88c96a52df tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1238 microversion: 2.1 time: 0.083499 May 24 10:14:48.977136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 29/57] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:48 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:49.658644 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:49.660158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:49.666650 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:49.667498 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:49.667884 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:49.668291 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:49.720224 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:49.720913 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:49.726889 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:49.727336 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:49.728288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:49.728904 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:49.808887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:49.817203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c4689767-e800-4047-a90c-9fd7d646a39a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1296 microversion: 2.1 time: 0.101459 May 24 10:14:49.820166 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 30/58] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:49 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:49.832831 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:49.833367 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:49.839528 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:49.843467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:49.843467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:49.843467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:49.849838 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:49.862249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b099ca76-7958-4304-9197-29096cb72dd7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.207647 May 24 10:14:49.872196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 29/59] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:49 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:49.978011 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:49.985518 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-642313af-d4e7-4d41-9b11-1a1a8f854ea6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.156786 May 24 10:14:49.985930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 31/60] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:49 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:49.994419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:49.995256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:50.002126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:50.002793 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:50.003554 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:50.004087 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:50.065059 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:50.072362 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ed04a195-71fc-4d1e-8d71-e853596fa8a5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1294 microversion: 2.1 time: 0.081715 May 24 10:14:50.072923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 30/61] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:49 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:50.835817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:50.836418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:50.842437 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:50.842877 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:50.843626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:50.844082 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:50.879315 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:50.879933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:50.886349 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:50.886795 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:50.887546 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:50.888000 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:50.906644 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:50.913992 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7448dfd6-08a5-4f59-9fbb-d6679810b353 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1296 microversion: 2.1 time: 0.081948 May 24 10:14:50.923653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 32/62] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:50 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:51.002860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:51.003620 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:51.009817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:51.010369 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:51.011135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:51.011731 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:51.017501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:51.024878 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b274faa1-f486-4be4-be6a-18322fa8067f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.149318 May 24 10:14:51.025527 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 31/63] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:50 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:51.090215 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:51.090735 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:51.096652 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:51.097100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:51.097855 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:51.098287 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:51.174281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:51.178501 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:51.181526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2a98ef0f-f4c6-45e2-9a52-06cd91ef4696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1294 microversion: 2.1 time: 0.095249 May 24 10:14:51.182101 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 32/64] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:51 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:51.187069 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-00378f85-dc90-4775-bbcd-6e412dcdec6d tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.187873 May 24 10:14:51.187744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 33/65] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:50 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:51.932570 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:51.933104 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:51.939743 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:51.940224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:51.940997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:51.941424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:52.003270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:52.010725 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f0cba41a-6c62-4f7c-942a-3c82c52efb05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1296 microversion: 2.1 time: 0.082113 May 24 10:14:52.011277 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 33/66] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:51 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:52.041680 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:52.042279 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:52.048432 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:52.048877 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:52.049725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:52.050152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:52.174688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:52.182556 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c910df22-7b8c-449b-a7ca-ebc6606a9a12 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.144562 May 24 10:14:52.183172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 34/67] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:52 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:52.199087 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:52.199701 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:52.203506 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:52.204137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:52.206132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:52.206578 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:52.207338 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:52.207766 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:52.210141 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:52.210578 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:52.211322 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:52.211748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:52.275925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:52.283672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b8603830-427e-4c96-9e68-de7a8d2361a6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1294 microversion: 2.1 time: 0.088601 May 24 10:14:52.284266 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 34/68] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:52 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:52.359928 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:52.367177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aae85e61-5ec1-48d9-8ef7-3629cadfbe8a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.167380 May 24 10:14:52.367741 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 35/69] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:52 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:53.027494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:53.028115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:53.034021 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.034450 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.035208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.035634 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.098279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:53.105660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9f0b1152-e528-4803-9953-b921c1bfd689 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1296 microversion: 2.1 time: 0.081949 May 24 10:14:53.106218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 35/70] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:53 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:53.199241 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:53.199867 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:53.206146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.211454 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.211454 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.211454 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.300930 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:53.301535 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:53.307751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.308237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.308999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.309444 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.337397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:53.345217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-be0df95d-84b1-4970-980c-db88fe4e4e1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.149764 May 24 10:14:53.345991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 36/71] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:53 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:53.377906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:53.383819 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:53.384426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:53.386804 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c2624f27-f23c-43b1-803d-fd6fa9e40c82 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1294 microversion: 2.1 time: 0.089642 May 24 10:14:53.387511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 36/72] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:53 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:53.391131 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.391586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.392380 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:53.392816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:53.534309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:53.542468 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4bc059ca-f7c4-414c-9fe0-5b0342ce12ec tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.162361 May 24 10:14:53.543128 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 37/73] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:53 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:54.129430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:54.130731 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:54.136547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.137003 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.137858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.138291 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.235670 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:54.242989 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b5935d7b-0303-4960-afd4-aa7cbb100912 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1296 microversion: 2.1 time: 0.117418 May 24 10:14:54.243547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 37/74] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:54 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1296 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:54.362060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:54.362674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:54.369062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.369062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.369868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.370296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.401121 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=4 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:54.405426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:54.406028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:54.417757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.417757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.417757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.417757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.531125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:54.541927 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-82789279-e094-493a-80eb-26dbeaba854e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1294 microversion: 2.1 time: 0.141639 May 24 10:14:54.544012 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 38/75] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:54 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:54.558383 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:54.559193 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:54.579209 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.579675 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.580496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:54.581196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:54.715243 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:54.724979 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-98505677-c302-4aa2-a105-f102958908e1 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.366226 May 24 10:14:54.725458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 38/76] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:54 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:54.795352 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:54.795352 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-947e63fd-c54e-4f3f-8feb-bc3348b90254 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.230030 May 24 10:14:54.795352 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 39/77] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:54 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:55.259953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:55.261821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:55.262504 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:55.267999 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.268442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:55.269247 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.269721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:55.484048 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=5 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:55.524400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:55.535531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-278ec154-2890-4fb7-bcde-abaa6c4e8b19 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.279460 May 24 10:14:55.553137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 39/78] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:55 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:55.564725 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:55.566826 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:55.577583 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.577583 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:55.578592 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.579227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:55.683052 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:55.692187 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b76602b6-1006-4f18-ae9d-ff473e33e140 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1312 microversion: 2.1 time: 0.134717 May 24 10:14:55.693542 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 40/79] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:55 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1312 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:55.741327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:55.742187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:55.749186 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.749637 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:55.753574 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.753574 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:55.771984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:55.801786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:55.802682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:55.816073 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.816866 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:55.819296 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:55.823873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:56.347159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:56.354430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:56.362596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2f57ac8b-74b1-444c-9163-22c09a5aa11b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.564567 May 24 10:14:56.377168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9255e3cc-f080-4e43-9833-ae908b345a65 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.639564 May 24 10:14:56.378200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 41/80] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:55 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:56.381079 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 40/81] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:55 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:56.559510 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:56.560695 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:56.572552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:56.572552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:56.572552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:56.572552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:56.715184 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:56.715784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:56.723226 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:56.723955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:56.724656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:56.725099 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:56.739230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=14 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:56.809345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:56.819204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a32382eb-e566-4839-8261-1b6b47c18a56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.263197 May 24 10:14:56.828963 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 42/82] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:56 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:56.942146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:56.955028 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-454ca3b2-dbaf-434d-92e0-d49ea886cd7b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.243824 May 24 10:14:56.955552 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 41/83] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:56 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:57.083728 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-e15be2da-6114-40d7-83f4-d8fe48db665b req-4e81f6fa-d268-4dcd-86df-ed0b14059a78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b45da9-b689-4ab8-aa70-2b00c4b687f5", "tag": "1b36d170-d593-4b40-ac32-fe6f8b4e2ca0"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:14:57.093452 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-e15be2da-6114-40d7-83f4-d8fe48db665b req-4e81f6fa-d268-4dcd-86df-ed0b14059a78 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.095704 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-e15be2da-6114-40d7-83f4-d8fe48db665b req-4e81f6fa-d268-4dcd-86df-ed0b14059a78 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.108833 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-e15be2da-6114-40d7-83f4-d8fe48db665b req-4e81f6fa-d268-4dcd-86df-ed0b14059a78 service nova] Creating event network-changed:1b36d170-d593-4b40-ac32-fe6f8b4e2ca0 for instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 on hv-cinder-81045 May 24 10:14:57.114033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-e15be2da-6114-40d7-83f4-d8fe48db665b req-4e81f6fa-d268-4dcd-86df-ed0b14059a78 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042217 May 24 10:14:57.114639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 43/84] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:14:57.386975 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:57.387787 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:57.401759 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:57.401759 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:57.401966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.401966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.401966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.402320 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.414194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.414651 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.415436 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.415896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.634728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:57.643006 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c590e04d-e5c5-4be3-9890-9c6cdc6e58b6 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.261840 May 24 10:14:57.643602 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 42/85] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:57 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:57.647197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:57.655418 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b27bc966-3ea1-4c7f-b224-04fd3d98bcb3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.262388 May 24 10:14:57.656005 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 44/86] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:57 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:57.836090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:57.836852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:57.843351 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.843837 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.844592 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.845057 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.973645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:57.974426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:57.980782 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.981231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:57.982623 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:57.983071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:58.006465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:58.013822 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cfd03835-6b4d-4db6-9a73-1e6d15358c15 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.181610 May 24 10:14:58.014426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 43/87] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:57 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:58.130163 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:58.138080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-65e856cb-f3b1-4c1c-999f-eefbc1439dfa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.168523 May 24 10:14:58.139659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 45/88] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:57 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:58.660608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:58.661222 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:58.668281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:58.668743 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:58.672484 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:58.672484 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:58.672738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:58.673754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:58.680641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:58.681195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:58.682080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:58.682612 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:58.687511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:14:58.895523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:58.907419 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d4ed6f3a-5c2d-46c4-a612-b9229c1213ac tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.250384 May 24 10:14:58.914464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 44/89] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:58 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:58.927509 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:58.937244 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-27381f46-0cb5-4927-8e2c-01f1d0b15ebe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.269140 May 24 10:14:58.938021 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 46/90] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:58 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:14:59.031380 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:59.032203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:59.039688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.039688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:59.040053 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.040465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:59.156677 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:59.157430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:59.164455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.164972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:59.166132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.166995 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:59.417679 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:59.427896 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-21747699-e289-4c81-8b18-e97d574b1d16 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.400767 May 24 10:14:59.428792 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 45/91] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:59 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:59.478796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:14:59.494105 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-99d0de3a-320c-4d25-9f44-24e0d5b9cc9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.340968 May 24 10:14:59.502765 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 47/92] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:59 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:14:59.929191 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:59.929814 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:59.945638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.946103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:59.946862 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.947290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:59.960292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:14:59.961483 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:14:59.975943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.978285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:14:59.983062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:14:59.983062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:00.371544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:00.381382 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a0764a7c-320f-42d7-8dde-558034bad5e9 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.455861 May 24 10:15:00.382280 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 46/93] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:59 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:00.434338 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:00.443156 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4b678e98-2832-4065-a79d-208bb8761fad tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.488228 May 24 10:15:00.446935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 48/94] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:14:59 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:00.452909 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-f9241a8f-d635-4a3c-8571-3cdda333a218 req-8aae54d6-df9d-46c6-b6d4-6acbaa8a230e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13731d69-8592-481c-b267-3415c90f91a1", "tag": "98030c8c-9e9d-4aa3-859e-11568c7b0b1d"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:00.475109 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-f9241a8f-d635-4a3c-8571-3cdda333a218 req-8aae54d6-df9d-46c6-b6d4-6acbaa8a230e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:00.478873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-f9241a8f-d635-4a3c-8571-3cdda333a218 req-8aae54d6-df9d-46c6-b6d4-6acbaa8a230e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:00.503786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-f9241a8f-d635-4a3c-8571-3cdda333a218 req-8aae54d6-df9d-46c6-b6d4-6acbaa8a230e service nova] Creating event network-changed:98030c8c-9e9d-4aa3-859e-11568c7b0b1d for instance 13731d69-8592-481c-b267-3415c90f91a1 on hv-cinder-81045 May 24 10:15:00.512570 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-f9241a8f-d635-4a3c-8571-3cdda333a218 req-8aae54d6-df9d-46c6-b6d4-6acbaa8a230e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064118 May 24 10:15:00.517049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 49/95] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:00.530684 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:00.531451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:00.541519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:00.541966 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:00.542736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:00.543200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:00.588017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-502ae65b-aaa0-4486-8e57-e1330ca87b3e req-fd0b00bb-9741-4357-870d-b6c1da90f8ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce032c3-2129-40d1-94b5-0c2b5f4aaa68", "name": "network-vif-plugged", "status": "completed", "tag": "71fb9519-9e7e-466c-8ff2-8f15ff74dc15"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:00.597914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-502ae65b-aaa0-4486-8e57-e1330ca87b3e req-fd0b00bb-9741-4357-870d-b6c1da90f8ce service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:00.598359 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-502ae65b-aaa0-4486-8e57-e1330ca87b3e req-fd0b00bb-9741-4357-870d-b6c1da90f8ce service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:00.611942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-502ae65b-aaa0-4486-8e57-e1330ca87b3e req-fd0b00bb-9741-4357-870d-b6c1da90f8ce service nova] Creating event network-vif-plugged:71fb9519-9e7e-466c-8ff2-8f15ff74dc15 for instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 on hv-cinder-81045 May 24 10:15:00.617255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-502ae65b-aaa0-4486-8e57-e1330ca87b3e req-fd0b00bb-9741-4357-870d-b6c1da90f8ce service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233825 May 24 10:15:00.617845 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 47/96] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:00.624380 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:00.625093 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:00.631570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:00.632367 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:00.633306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:00.633742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:00.719158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:00.725883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ee564a24-b2ce-4496-95e9-11eb9c0ccf56 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.207552 May 24 10:15:00.727090 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 50/97] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:00 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:00.817823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:00.825140 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-affa21b7-168e-4554-90bd-98e24532d407 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.206051 May 24 10:15:00.825688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 48/98] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:00 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:01.398876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:01.399549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:01.419303 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.420594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.421617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.423028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.465070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:01.465678 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:01.491523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.491993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.505065 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.505065 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.635320 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:01.644134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-978aa135-503d-497b-b81d-9622c19aa30f tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.248937 May 24 10:15:01.644816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 51/99] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:01 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:01.693876 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:01.701651 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ef0f256d-19f7-4f7b-9e5c-d909c7d8edea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.240160 May 24 10:15:01.702223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 49/100] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:01 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:01.743530 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:01.744169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:01.750764 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.751230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.752018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.752448 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.842676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:01.843276 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:01.849307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.849743 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.850494 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:01.850916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:01.902227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:01.913652 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c7cd1ed3-dc39-46b3-b18b-8c589352ba45 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.173964 May 24 10:15:01.914228 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 52/101] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:01 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:01.988038 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:01.998419 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9b9d05db-c4f6-4f8d-b897-71b5cd94c0ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.159571 May 24 10:15:01.999381 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 50/102] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:01 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:02.632939 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-fe8d9cc7-8f5f-4994-8356-8ee4d01344e1 req-4e130fb3-8383-4433-ac5e-e8c33df727bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5360b6-0f14-4294-b939-f78a1edf56e5", "name": "network-vif-plugged", "status": "completed", "tag": "9226c32d-cef5-4afb-bbe7-9569cc180068"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:02.641552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-fe8d9cc7-8f5f-4994-8356-8ee4d01344e1 req-4e130fb3-8383-4433-ac5e-e8c33df727bb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:02.641999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-fe8d9cc7-8f5f-4994-8356-8ee4d01344e1 req-4e130fb3-8383-4433-ac5e-e8c33df727bb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:02.653746 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-fe8d9cc7-8f5f-4994-8356-8ee4d01344e1 req-4e130fb3-8383-4433-ac5e-e8c33df727bb service nova] Creating event network-vif-plugged:9226c32d-cef5-4afb-bbe7-9569cc180068 for instance ee5360b6-0f14-4294-b939-f78a1edf56e5 on hv-cinder-81045 May 24 10:15:02.660371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-fe8d9cc7-8f5f-4994-8356-8ee4d01344e1 req-4e130fb3-8383-4433-ac5e-e8c33df727bb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031003 May 24 10:15:02.661259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 53/103] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:02.663068 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:02.663722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:02.670817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:02.671464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:02.672282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:02.672857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:02.719264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:02.720139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:02.726528 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:02.726979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:02.727739 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:02.728396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:02.845646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:02.853266 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c73a292c-433b-433d-b199-af528a09d60e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.195839 May 24 10:15:02.853771 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 51/104] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:02 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:02.931327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:02.932284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:02.940170 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:02.940937 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:02.941854 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:02.942433 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:03.111643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:03.119246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-29a01a44-1c22-4846-b41d-cccf42653f7d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.404372 May 24 10:15:03.119834 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 54/105] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:02 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:03.124775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:03.125288 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:03.131379 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:03.131845 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:03.132604 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:03.133037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:03.159310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:03.168247 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-24920572-ca4e-427d-b42f-99f58a452ea0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.241455 May 24 10:15:03.169563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 52/106] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:02 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:03.273456 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:03.281518 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8076d89e-5098-4bcc-a0df-dbebf6c5527d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.160680 May 24 10:15:03.282098 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 55/107] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:03 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:03.870553 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:03.871164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:03.877463 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:03.877907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:03.878668 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:03.879094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.006784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:04.015268 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cb146347-38ea-4e04-bfb3-72ce5a9f7d84 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.148477 May 24 10:15:04.016059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 53/108] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:03 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:04.135311 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:04.135935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:04.142490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:04.142952 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.143696 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:04.144146 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.186362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:04.187000 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:04.192961 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:04.193344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.194130 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:04.194559 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.311189 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:04.318480 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bce1ee95-a575-40b5-b943-3501949bfdb7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.186891 May 24 10:15:04.319047 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 56/109] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:04 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:04.323552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:04.324172 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:04.330594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:04.331311 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.332084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:04.332519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.354824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:04.363355 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-256a9047-fbf8-497b-a564-881cd837dec6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.181248 May 24 10:15:04.364162 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 54/110] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:04 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:04.459835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:04.467926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-46600c87-ffd7-4ce3-8f25-1831dc92ac35 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.147921 May 24 10:15:04.468481 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 57/111] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:04 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:04.692916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-ba2ac082-a3fe-4290-b4ac-7901454962f4 req-6e098850-7e59-4cb5-a912-c602f2215302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80399184-6140-46b7-9089-6a315714fa4b", "name": "network-vif-plugged", "status": "completed", "tag": "f74bf4d2-24ef-446e-a89a-89504b608d16"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:04.704127 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ba2ac082-a3fe-4290-b4ac-7901454962f4 req-6e098850-7e59-4cb5-a912-c602f2215302 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:04.704127 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-ba2ac082-a3fe-4290-b4ac-7901454962f4 req-6e098850-7e59-4cb5-a912-c602f2215302 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:04.713717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-ba2ac082-a3fe-4290-b4ac-7901454962f4 req-6e098850-7e59-4cb5-a912-c602f2215302 service nova] Creating event network-vif-plugged:f74bf4d2-24ef-446e-a89a-89504b608d16 for instance 80399184-6140-46b7-9089-6a315714fa4b on hv-cinder-81045 May 24 10:15:04.719166 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-ba2ac082-a3fe-4290-b4ac-7901454962f4 req-6e098850-7e59-4cb5-a912-c602f2215302 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029849 May 24 10:15:04.719815 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 55/112] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:05.031921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:05.032523 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:05.038523 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.038967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.039715 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.174652 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:05.182143 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-88db78ff-0e2a-4b65-a4d5-08b0f1a103b1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.154085 May 24 10:15:05.182714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 58/113] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:05 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:05.336719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:05.337589 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:05.344245 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.344726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.345502 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.345941 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.380174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:05.381005 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:05.388080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.388883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.389941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.390580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.610389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:05.618559 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a3fbc94b-f98a-43d0-a9b0-5f2504dc3e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.285967 May 24 10:15:05.619251 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 56/114] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:05 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:05.624732 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:05.625404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:05.631615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.632439 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.633442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:05.634076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:05.674502 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:05.687481 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c6c3a7c8-44de-4635-8e35-49f9b489a78e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.311164 May 24 10:15:05.688275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 59/115] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:05 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:05.864550 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:05.877306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a4c3fdba-4487-45ca-a626-8256296b2812 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.256654 May 24 10:15:05.879676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 57/116] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:05 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:06.198648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:06.200079 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:06.209334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.210129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:06.211155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.211911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:06.428224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:06.442222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e580b809-68b3-4675-b3d9-a04fc036fc11 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.247308 May 24 10:15:06.442789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 60/117] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:06 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:06.637744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:06.640740 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:06.660372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.660850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:06.666295 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.666807 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:06.704520 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:06.705530 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:06.713756 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.718047 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:06.720227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.724404 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:06.752824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:06.971454 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:06.976515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:06.979069 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cfaad090-6aab-4be3-bc1d-facdeb17130d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.278617 May 24 10:15:06.979641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 61/118] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:06 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:06.984363 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:06.984566 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-56d2038d-743f-479a-9f07-daac36f285af tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.351912 May 24 10:15:06.985267 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:06.987899 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 58/119] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:06 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:06.990834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-8f510816-a05d-4692-ba59-f1f7ce6577e2 req-fc5b3e8f-7f7e-40f1-a295-69f208cbb789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b45da9-b689-4ab8-aa70-2b00c4b687f5", "name": "network-vif-plugged", "status": "completed", "tag": "1b36d170-d593-4b40-ac32-fe6f8b4e2ca0"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:06.993260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.993702 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:06.994455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:06.994942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:07.001319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8f510816-a05d-4692-ba59-f1f7ce6577e2 req-fc5b3e8f-7f7e-40f1-a295-69f208cbb789 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:07.001899 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8f510816-a05d-4692-ba59-f1f7ce6577e2 req-fc5b3e8f-7f7e-40f1-a295-69f208cbb789 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:07.013742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-8f510816-a05d-4692-ba59-f1f7ce6577e2 req-fc5b3e8f-7f7e-40f1-a295-69f208cbb789 service nova] Creating event network-vif-plugged:1b36d170-d593-4b40-ac32-fe6f8b4e2ca0 for instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 on hv-cinder-81045 May 24 10:15:07.020422 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-8f510816-a05d-4692-ba59-f1f7ce6577e2 req-fc5b3e8f-7f7e-40f1-a295-69f208cbb789 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 May 24 10:15:07.021106 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 59/120] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:07.140082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:07.148823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3a100bf1-5a8a-4ec7-9482-7fa549d4674c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.167942 May 24 10:15:07.149407 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 62/121] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:06 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:07.459395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:07.460309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:07.466425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:07.466964 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:07.467787 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:07.468849 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:07.599564 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:07.606811 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5ca7a898-216d-4d18-87c4-3586036ec341 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1315 microversion: 2.1 time: 0.151843 May 24 10:15:07.607373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 60/122] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:07 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:07.995955 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:08.002876 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:08.004640 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:08.005398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:08.021161 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.021610 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.022504 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.023690 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.026243 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.026774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.027398 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.028412 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.236743 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:08.240860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:08.244641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7766d030-243a-45e5-80fa-dae056eeae1d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.252842 May 24 10:15:08.245415 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 63/123] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:07 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:08.249682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:08.249821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-70aefc2d-e5dd-49a1-b406-86b54993f318 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1322 microversion: 2.1 time: 0.251539 May 24 10:15:08.250598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:08.263280 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 61/124] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:07 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:08.263512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.263512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.263512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.263512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.268176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:08.420993 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:08.429408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a76464b1-9063-47eb-8348-b9dc39e2631b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.183150 May 24 10:15:08.430230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 64/125] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:08 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:08.627931 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:08.628858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:08.656849 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.658766 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.661333 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:08.662125 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:08.872390 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:08.885634 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5099e622-0f60-4c00-aac8-17f68fe364bf tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1503 microversion: 2.1 time: 0.264313 May 24 10:15:08.894479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 62/126] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:08 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:09.049969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-4c6deabc-5098-4e3a-9ac5-e0e65fa6cc3c req-44c098cd-303b-47be-b6ee-e62f6e90172e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13731d69-8592-481c-b267-3415c90f91a1", "name": "network-vif-plugged", "status": "completed", "tag": "98030c8c-9e9d-4aa3-859e-11568c7b0b1d"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:09.064727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-4c6deabc-5098-4e3a-9ac5-e0e65fa6cc3c req-44c098cd-303b-47be-b6ee-e62f6e90172e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.065430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-4c6deabc-5098-4e3a-9ac5-e0e65fa6cc3c req-44c098cd-303b-47be-b6ee-e62f6e90172e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.076881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-4c6deabc-5098-4e3a-9ac5-e0e65fa6cc3c req-44c098cd-303b-47be-b6ee-e62f6e90172e service nova] Creating event network-vif-plugged:98030c8c-9e9d-4aa3-859e-11568c7b0b1d for instance 13731d69-8592-481c-b267-3415c90f91a1 on hv-cinder-81045 May 24 10:15:09.082705 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-4c6deabc-5098-4e3a-9ac5-e0e65fa6cc3c req-44c098cd-303b-47be-b6ee-e62f6e90172e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045115 May 24 10:15:09.083298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 65/127] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:09.261104 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:09.261705 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:09.267154 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:09.267863 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:09.268211 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.268655 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.269640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.270079 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.273978 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.274646 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.275396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.276028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.469422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:09.477002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-05df5411-bf97-4202-b1e8-83f535d1d09b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1516 microversion: 2.1 time: 0.214487 May 24 10:15:09.479920 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 66/128] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:09 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:09.482179 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:09.482775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:09.489390 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:09.492515 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.493160 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.494130 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.494593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.498467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-20180bd5-661f-4591-9b13-3bf511fc9947 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.241113 May 24 10:15:09.499360 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 63/129] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:09 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:09.505225 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:09.506407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:09.512744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.513188 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.513945 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:09.514371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:09.587157 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lazy-loading 'flavor' on Instance uuid 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:15:09.644950 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:09.656994 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fbc84b6a-0c00-4926-8e3a-b55c77d25b06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.178092 May 24 10:15:09.658457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 67/130] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:09 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:10.099743 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2978c349-ed2f-4f4e-8ecf-18c898512245 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68/action" status: 200 len: 32 microversion: 2.1 time: 0.598223 May 24 10:15:10.100396 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 64/131] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:15:09 2022] POST /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68/action => generated 32 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:15:10.109256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:10.109939 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:10.115874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:10.116347 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:10.117107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:10.117532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:10.252077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:10.259438 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-99e090b2-b861-4572-906f-75403181b64a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.154063 May 24 10:15:10.260035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 68/132] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:10 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:10.516932 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:10.517809 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:10.524110 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:10.524555 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:10.525318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:10.525749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:10.666868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:10.674586 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:10.675173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a360b7d9-ddfe-452c-9fa0-06fb72875983 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.162429 May 24 10:15:10.675329 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:10.676436 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 65/133] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:10 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:10.681097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:10.681534 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:10.682274 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:10.682700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:10.823682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:10.832251 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-71198ce9-d86f-408b-b0b4-54e7e62bbb19 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.161729 May 24 10:15:10.832818 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 69/134] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:10 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:11.277009 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:11.277733 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:11.283853 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:11.284308 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:11.285158 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:11.285498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:11.418540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:11.426811 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f9053bf2-fdd4-4dc3-bb6e-8f1a75cc0ab4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.153622 May 24 10:15:11.427374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 66/135] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:11 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:11.693103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:11.693709 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:11.699738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:11.700217 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:11.700974 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:11.701496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:11.849091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:11.851475 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:11.852245 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:11.855779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:11.858222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d3db2444-9a50-4e06-94b8-7a7df78c09de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.168811 May 24 10:15:11.859420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 70/136] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:11 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:11.863658 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:11.864411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:11.865485 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:11.866345 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:12.004309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:12.013328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b72da67a-d41a-4ad3-be65-c861f45efe97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.165626 May 24 10:15:12.023613 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 67/137] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:11 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:12.444216 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:12.444903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:12.450994 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:12.451431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:12.452251 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:12.452728 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:12.583653 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:12.591207 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bbf50057-48bf-4ded-ad28-7670825ee062 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.150927 May 24 10:15:12.591769 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 71/138] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:12 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:12.876791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:12.877400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:12.886817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:12.887486 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:12.888291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:12.888729 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:12.998876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9d9b30a3-d8f0-449b-b4f8-5f6afa811145 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c206b308-95cb-415f-b23e-702fced78cd2"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:13.001095 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9d9b30a3-d8f0-449b-b4f8-5f6afa811145 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:13.010734 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d9b30a3-d8f0-449b-b4f8-5f6afa811145 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:13.012233 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d9b30a3-d8f0-449b-b4f8-5f6afa811145 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:13.013283 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d9b30a3-d8f0-449b-b4f8-5f6afa811145 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:13.014617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d9b30a3-d8f0-449b-b4f8-5f6afa811145 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:13.027015 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:13.039093 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6d9e113c-e7e9-4e78-b154-77857e4039e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.166201 May 24 10:15:13.040527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 68/139] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:12 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:13.048113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:13.049059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:13.055453 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:13.056097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:13.056894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:13.057320 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:13.208749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:13.216117 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d4862d0c-7e68-44d9-b660-bd965c765b48 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.174348 May 24 10:15:13.216677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 69/140] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:13 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:13.608465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:13.609891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:13.616048 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:13.618306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:13.619439 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:13.620067 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:13.856920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:13.865431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7111d56b-b306-41c1-97d9-7a6203963d5e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.260705 May 24 10:15:13.866000 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 70/141] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:13 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:14.057284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:14.057933 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:14.064514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:14.064991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:14.065840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:14.066274 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:14.078513 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9d9b30a3-d8f0-449b-b4f8-5f6afa811145 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "POST /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.084534 May 24 10:15:14.079377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 72/142] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:15:12 2022] POST /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b/os-volume_attachments => generated 194 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:15:14.212496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:14.221310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fcfc5c02-95f3-4348-b3df-f8b7b2947b33 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.167789 May 24 10:15:14.221966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 71/143] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:14 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:14.234247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:14.235292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:14.238462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:14.242130 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:14.242580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:14.243349 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:14.243788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:14.529367 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:14.537550 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-93679e57-ce9e-4de4-bbc7-25b5a641abfe tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.307648 May 24 10:15:14.541053 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 73/144] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:14 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:14.882035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:14.882630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:14.888593 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:14.889031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:14.889772 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:14.890221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:15.037048 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:15.044758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0b42a864-abeb-4f39-bddd-6d9ecba5c5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.166357 May 24 10:15:15.054652 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 72/145] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:14 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:15.237261 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:15.237799 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:15.244091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:15.244531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:15.245580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:15.246041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:15.400037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:15.407675 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e9e63f46-8a3b-4214-ad9d-81518d659237 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.174521 May 24 10:15:15.408282 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 74/146] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:15 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:15.555411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:15.556057 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:15.562793 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:15.563243 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:15.564037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:15.564474 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:15.694623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:15.696964 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:15.702991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e954f4a8-d0a9-44d9-afa2-362ed657506e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.151393 May 24 10:15:15.703629 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 73/147] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:15 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:16.062645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:16.063760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:16.070371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:16.070896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:16.071730 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:16.072282 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:16.201621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:16.209489 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bf763cc6-abbf-4d1f-b2af-033c6b16b36b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.151697 May 24 10:15:16.210143 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 75/148] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:16 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:16.426779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:16.427918 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:16.442186 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:16.442840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:16.443741 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:16.444352 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:16.589515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:16.611369 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2f006549-3350-4806-8b75-f59ac5e300dc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.190205 May 24 10:15:16.611975 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 74/149] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:16 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:16.727485 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:16.727485 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:16.727485 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:16.727485 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:16.728217 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:16.728627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:16.860886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:16.870878 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ba4f8cf0-ccaa-428e-97f2-727833c61bfc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.154651 May 24 10:15:16.871468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 76/150] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:16 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:17.226451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:17.227047 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:17.233330 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:17.234318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:17.235190 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:17.235616 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:17.364695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:17.372368 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7d13f424-5291-4dbe-b2bf-7a31be7a9ca4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.149690 May 24 10:15:17.372920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 75/151] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:17 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:17.627102 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:17.627632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:17.633976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:17.634422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:17.635175 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:17.635605 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:17.769617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:17.776944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3343293d-ace5-4f73-9742-a30b19e98527 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1362 microversion: 2.1 time: 0.153723 May 24 10:15:17.787074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 77/152] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:17 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:17.887281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:17.887878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:17.894466 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:17.894907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:17.895656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:17.896110 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:18.022754 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:18.030153 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b213d8d6-3def-4c86-b521-dddbb99dfba9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.147006 May 24 10:15:18.030799 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 76/153] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:17 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:18.389340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:18.390369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:18.396675 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:18.397125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:18.398088 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:18.398525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:18.716567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:18.724467 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7105e0c3-913e-4263-8e55-c4fed4e9d916 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.338995 May 24 10:15:18.725037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 78/154] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:18 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:18.794519 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:18.795358 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:18.802394 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:18.802903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:18.803724 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:18.804242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:18.944465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:18.953758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7f6f4f1d-d1c1-4eff-852e-5ef451fac002 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1548 microversion: 2.1 time: 0.163123 May 24 10:15:18.956075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 77/155] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:18 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:18.975296 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2cc3c4d4-3537-450d-b5ea-f156a23b714d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:18.975919 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2cc3c4d4-3537-450d-b5ea-f156a23b714d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:18.982221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2cc3c4d4-3537-450d-b5ea-f156a23b714d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:18.982673 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2cc3c4d4-3537-450d-b5ea-f156a23b714d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:18.984168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2cc3c4d4-3537-450d-b5ea-f156a23b714d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:18.984594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2cc3c4d4-3537-450d-b5ea-f156a23b714d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:19.047023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:19.047821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:19.055375 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:19.056176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:19.057897 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:19.059026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:19.078307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2cc3c4d4-3537-450d-b5ea-f156a23b714d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110447 May 24 10:15:19.085179 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 79/156] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:15:18 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:19.210936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:19.220161 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9247a622-8ef5-4e57-a7cc-c87ae55d3be4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1368 microversion: 2.1 time: 0.177587 May 24 10:15:19.220771 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 78/157] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:19 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:19.741751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:19.742439 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:19.748660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:19.749189 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:19.750154 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:19.750594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:19.778269 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:19.943975 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:19.952007 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c62eff01-b07e-4bc4-a9bf-50912d30f24a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.214630 May 24 10:15:19.952614 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 80/158] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:19 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:20.386699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:20.389819 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:20.393499 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:20.393948 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:20.394730 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:20.395151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:20.584823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:20.597408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-00975754-77d0-4bb9-9a2b-141e235d5ebd tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1559 microversion: 2.1 time: 0.214433 May 24 10:15:20.598153 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 79/159] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:20 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:20.617336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-510fac8e-0650-4ca7-93c2-a97174682a49 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:20.618419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-510fac8e-0650-4ca7-93c2-a97174682a49 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:20.627129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-510fac8e-0650-4ca7-93c2-a97174682a49 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:20.627827 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-510fac8e-0650-4ca7-93c2-a97174682a49 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:20.628973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-510fac8e-0650-4ca7-93c2-a97174682a49 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:20.629897 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-510fac8e-0650-4ca7-93c2-a97174682a49 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:20.716074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-510fac8e-0650-4ca7-93c2-a97174682a49 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102859 May 24 10:15:20.716736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 81/160] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:15:20 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:20.808962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-2d47c8c3-8906-44f8-a887-53e479af28ec req-a061b979-6758-437a-bda6-2cf45af68b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8b45da9-b689-4ab8-aa70-2b00c4b687f5", "tag": "1b36d170-d593-4b40-ac32-fe6f8b4e2ca0"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:20.817987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-2d47c8c3-8906-44f8-a887-53e479af28ec req-a061b979-6758-437a-bda6-2cf45af68b1a service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:20.818411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-2d47c8c3-8906-44f8-a887-53e479af28ec req-a061b979-6758-437a-bda6-2cf45af68b1a service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:20.831481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-2d47c8c3-8906-44f8-a887-53e479af28ec req-a061b979-6758-437a-bda6-2cf45af68b1a service nova] Creating event network-changed:1b36d170-d593-4b40-ac32-fe6f8b4e2ca0 for instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 on hv-cinder-81045 May 24 10:15:20.836341 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-2d47c8c3-8906-44f8-a887-53e479af28ec req-a061b979-6758-437a-bda6-2cf45af68b1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030890 May 24 10:15:20.839624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 80/161] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:20.970237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:20.971324 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:20.980169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:20.981171 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:20.982961 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:20.993433 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:21.321381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:21.327230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8da954c7-5243-4248-8faf-daeff6a5275b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.361944 May 24 10:15:21.328143 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 82/162] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:20 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:22.062595 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-26e7babd-7974-492d-99b7-9bf31ff62682 req-d149358a-262c-4a70-a257-ccd61d8a07c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13731d69-8592-481c-b267-3415c90f91a1", "tag": "98030c8c-9e9d-4aa3-859e-11568c7b0b1d"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:22.077858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-26e7babd-7974-492d-99b7-9bf31ff62682 req-d149358a-262c-4a70-a257-ccd61d8a07c2 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:22.077858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-26e7babd-7974-492d-99b7-9bf31ff62682 req-d149358a-262c-4a70-a257-ccd61d8a07c2 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:22.087183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-26e7babd-7974-492d-99b7-9bf31ff62682 req-d149358a-262c-4a70-a257-ccd61d8a07c2 service nova] Creating event network-changed:98030c8c-9e9d-4aa3-859e-11568c7b0b1d for instance 13731d69-8592-481c-b267-3415c90f91a1 on hv-cinder-81045 May 24 10:15:22.092749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-26e7babd-7974-492d-99b7-9bf31ff62682 req-d149358a-262c-4a70-a257-ccd61d8a07c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034596 May 24 10:15:22.094476 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 81/163] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:15:22.344935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:22.345468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:22.352457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:22.352457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:22.353218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:22.353645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:22.494200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:22.502573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1155ec5e-2aec-4d9d-872e-7e93aa34b2f7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.161535 May 24 10:15:22.503279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 83/164] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:22 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:23.520140 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:23.520839 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:23.537744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:23.538442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:23.539240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:23.539850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:23.955789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:23.968676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3a6e1114-1219-4d67-9fa4-8284cd390f56 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.452395 May 24 10:15:23.969066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 82/165] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:23 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:24.985807 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:24.986511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:24.993468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:24.993979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:24.994803 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:24.995316 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:25.132942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:25.140573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-20156a3f-98e1-4ae7-ad73-542e438d6494 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.159489 May 24 10:15:25.141152 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 84/166] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:24 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:26.158382 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:26.158987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:26.164996 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:26.165372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:26.166119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:26.166544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:26.293020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:26.300955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3a843e8a-629a-4a7c-8361-0615991bbdc2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.147527 May 24 10:15:26.301524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 83/167] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:26 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:27.317479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:27.318185 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:27.324785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:27.325230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:27.327605 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:27.327605 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:27.455646 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:27.463621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f742ce43-2a79-4107-bb6a-ca2918d6020d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.150154 May 24 10:15:27.464711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 85/168] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:27 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:28.481018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:28.481591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:28.488316 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:28.488757 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:28.489512 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:28.489934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:28.631336 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:28.639626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c77e5aa8-4ef0-460d-907b-0c0ae266bc69 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.162824 May 24 10:15:28.640281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 84/169] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:28 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:29.657623 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:29.658221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:29.665264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:29.665707 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:29.666474 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:29.666902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:29.835060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:29.842700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-345743a9-a685-4ad4-8657-891f27523296 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.189916 May 24 10:15:29.843262 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 86/170] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:29 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:30.859590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:30.861959 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:30.868449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:30.868983 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:30.869966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:30.870675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:31.017865 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:31.026957 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8ec09f83-094d-4778-a953-d50b578a13d3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.171162 May 24 10:15:31.027523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 85/171] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:30 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:32.047116 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:32.047786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:32.054553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:32.054996 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:32.055752 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:32.056211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:32.220004 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:32.220004 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7db22710-0588-45be-8cae-298fa4a58004 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.176022 May 24 10:15:32.220571 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 87/172] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:32 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:33.237767 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:33.238137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:33.248784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:33.249335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:33.250180 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:33.250625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:33.391951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:33.399662 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c24e2cfc-cba2-4945-8bb8-385267b9b9a2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.167004 May 24 10:15:33.400278 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 86/173] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:33 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:34.421567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:34.421567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:34.424071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:34.424514 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:34.425477 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:34.425900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:34.589032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:34.597946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9d8ce72f-db6a-4017-819d-0c3a55df1590 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.184911 May 24 10:15:34.598522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 88/174] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:34 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:35.615211 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:35.615583 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:35.622303 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:35.622753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:35.623522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:35.629579 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:35.765884 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:35.775173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9683d803-dbf9-448e-890f-08d779718773 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.164528 May 24 10:15:35.775870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 87/175] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:35 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:36.799901 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:36.800676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:36.815344 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:36.815841 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:36.816615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:36.817044 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:36.948391 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:36.956706 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c6fe0de0-771c-4f46-a0e9-c8ef9d71e030 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.162120 May 24 10:15:36.957274 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 89/176] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:36 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:37.462752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:37.463262 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:37.469543 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:37.469983 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:37.470735 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:37.471160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:37.499742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:15:37.831779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f0358dcc-6f04-439f-924e-1b7bcc8870cb tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "DELETE /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 204 len: 0 microversion: 2.1 time: 0.372445 May 24 10:15:37.832336 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 88/177] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:15:37 2022] DELETE /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:15:37.840479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:37.841471 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:37.849201 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:37.849655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:37.850430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:37.851309 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:37.976800 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:37.978676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:37.986256 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:37.986406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:37.987084 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:37.988284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:37.989054 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:37.995828 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5e850243-a60b-40c2-a9d4-e90ebd6d52df tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1555 microversion: 2.1 time: 0.159170 May 24 10:15:38.006574 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 90/178] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:37 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:38.126720 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:38.134458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-46f8096c-797d-4063-a010-2645458fdf0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.162886 May 24 10:15:38.135025 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 89/179] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:37 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:39.014614 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:39.015213 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:39.023020 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:39.023714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:39.024795 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:39.025375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:39.159718 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:39.160754 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:39.169656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:39.170332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:39.171297 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:39.172081 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:39.177304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:39.186757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ebbd2002-5072-4c66-964b-e6e866c0dfad tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1555 microversion: 2.1 time: 0.175902 May 24 10:15:39.190097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 91/180] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:39 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:39.191649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:39.321875 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:39.334534 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8f869fb6-3e61-49bb-bbf8-54486171bdc0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.185041 May 24 10:15:39.335120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 90/181] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:39 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:40.210913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:40.211582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:40.218365 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:40.218958 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:40.220016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:40.220421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:40.351832 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:40.352670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:40.355750 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:40.360090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:40.360840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:40.361802 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:40.362395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:40.364427 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-73a26564-5d4a-47c4-b8e4-d008fec2dabc tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1555 microversion: 2.1 time: 0.157597 May 24 10:15:40.364998 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 92/182] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:40 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:40.499544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:40.507136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-82bd137f-996f-423d-8e4e-5a7cb5e47adc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.160054 May 24 10:15:40.507703 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 91/183] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:40 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:41.382050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:41.382503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:41.389132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:41.389583 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:41.390351 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:41.390781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:41.524028 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:41.524638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:41.527771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:41.530523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:41.530974 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:41.531730 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:41.532394 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:41.536457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3aec329e-371d-4610-b7c4-90527bc4d73e tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1555 microversion: 2.1 time: 0.158602 May 24 10:15:41.537141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 93/184] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:41 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:41.661551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:41.669089 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0920bf99-7b38-46f4-bef0-c6f6fd2c727d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.149244 May 24 10:15:41.669717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 92/185] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:41 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:42.554076 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:42.554671 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:42.561068 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:42.561536 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:42.563131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:42.563577 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:42.687683 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:42.692539 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:42.692539 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:42.695194 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:42.695640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:42.696431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:42.696864 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:42.697231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:42.707445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8b20315b-c754-4e42-a129-d595c60ce8d1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1555 microversion: 2.1 time: 0.157752 May 24 10:15:42.708065 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 94/186] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:42 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:42.828356 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:42.837424 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5e3b2d61-989c-4f1a-9eea-f3527aa67870 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.154897 May 24 10:15:42.838160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 93/187] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:42 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:43.733281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:43.733887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:43.742275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:43.742934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:43.744348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:43.744778 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:43.757441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-06ba81cb-afd4-4f7c-b589-c0e40d8aa889 req-14a0a3bc-f54c-43f1-a544-2de876185e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80399184-6140-46b7-9089-6a315714fa4b", "name": "network-vif-deleted", "tag": "f74bf4d2-24ef-446e-a89a-89504b608d16"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:43.772595 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-06ba81cb-afd4-4f7c-b589-c0e40d8aa889 req-14a0a3bc-f54c-43f1-a544-2de876185e4f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:43.782699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-06ba81cb-afd4-4f7c-b589-c0e40d8aa889 req-14a0a3bc-f54c-43f1-a544-2de876185e4f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:43.791874 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-06ba81cb-afd4-4f7c-b589-c0e40d8aa889 req-14a0a3bc-f54c-43f1-a544-2de876185e4f service nova] Creating event network-vif-deleted:f74bf4d2-24ef-446e-a89a-89504b608d16 for instance 80399184-6140-46b7-9089-6a315714fa4b on hv-cinder-81045 May 24 10:15:43.797621 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-06ba81cb-afd4-4f7c-b589-c0e40d8aa889 req-14a0a3bc-f54c-43f1-a544-2de876185e4f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044065 May 24 10:15:43.798597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 94/188] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:15:43.831197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:43.839032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fdcf1cf9-c642-4269-a3f3-1cc9219ea88b tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1513 microversion: 2.1 time: 0.109823 May 24 10:15:43.839585 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 95/189] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:43 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1513 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:43.857012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:43.858020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:43.867838 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:43.868711 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:43.870587 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:43.882187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:44.048054 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:44.055493 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-976fa28b-011a-46c4-92d4-1d8698af4f5b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.204125 May 24 10:15:44.056084 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 95/190] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:43 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:44.855928 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:44.856529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:44.858918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=45 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:44.864211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:44.864653 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:44.865400 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:44.865833 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:44.896776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:44.897240 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:44.897697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lazy-loading 'fault' on Instance uuid 80399184-6140-46b7-9089-6a315714fa4b {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:15:44.943291 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '663b8de7a75342e28e9d2061efad8305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aeb238c6f4b4c67b876c966b62d3e86', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:44.952864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4740876b-5a6f-4f89-a331-fad7f39fad3a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 200 len: 1351 microversion: 2.1 time: 0.100736 May 24 10:15:44.953581 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 96/191] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:44 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 1351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:45.074481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:45.076176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:45.083155 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:45.083717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:45.084585 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:45.085113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:45.259575 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:45.264835 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ffe67eaf-a7fa-4d99-be47-35d95e05667a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.195780 May 24 10:15:45.265405 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 96/192] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:45 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:45.974762 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:45.975297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:45.982209 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:45.982661 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:45.983424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:45.983894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:45.988312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:15:45.997731 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] HTTP exception thrown: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Request method failure captured: May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b HTTP/1.1 May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_5UpiK_sJu-L65bhF-W6plYexNHrhLrYB-I1cJUTO6R8OHhJMtXJfg-M1_4eTQJ_B7bxhSWFILG4eURbwEip8RiSSEIrBmeSHYqWSbeYGjmmwmYteNrT6AsdtfvaECd_WwlJJt1l5PSsmz-z2ur5T_jB3RF3ywiyKJpLfnAgR0VT0 May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:15:46.003294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1aeb238c6f4b4c67b876c966b62d3e86", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-DeleteServersTestJSON-812426952 May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 663b8de7a75342e28e9d2061efad8305 May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.004813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '80399184-6140-46b7-9089-6a315714fa4b'} May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:46.005876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.008024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:46.009070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Returning 404 to user: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:46.009070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-347f2bb1-7bd5-4b1a-a2e0-0336f93493c1 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 404 len: 111 microversion: 2.1 time: 0.033200 May 24 10:15:46.015925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 97/193] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:45 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:15:46.132296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:46.133215 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:46.139041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:46.139652 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:46.141208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:46.141672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:46.155044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] HTTP exception thrown: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Request method failure captured: May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b/os-volume_attachments HTTP/1.1 May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijK_5UpiK_sJu-L65bhF-W6plYexNHrhLrYB-I1cJUTO6R8OHhJMtXJfg-M1_4eTQJ_B7bxhSWFILG4eURbwEip8RiSSEIrBmeSHYqWSbeYGjmmwmYteNrT6AsdtfvaECd_WwlJJt1l5PSsmz-z2ur5T_jB3RF3ywiyKJpLfnAgR0VT0 May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:15:46.160059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1aeb238c6f4b4c67b876c966b62d3e86", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-DeleteServersTestJSON-812426952 May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 663b8de7a75342e28e9d2061efad8305 May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.161537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'server_id': '80399184-6140-46b7-9089-6a315714fa4b'} May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:46.162332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:46.163817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:46.165447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Returning 404 to user: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:46.165447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-99e592cb-eeb3-44ad-b00b-0d08d3a15323 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033069 May 24 10:15:46.165447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 97/194] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:15:46 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:15:46.283185 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:46.284239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:46.290859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:46.291293 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:46.292255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:46.292837 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:46.458860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:46.468629 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cb490383-50a3-4793-802d-125fd037c670 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.189884 May 24 10:15:46.469312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 98/195] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:46 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:47.487694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:47.488351 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:47.507645 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:47.508062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:47.509008 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:47.512792 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:47.529209 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:47.530115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:47.541131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:47.543775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:47.543775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:47.543775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:47.561737 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] HTTP exception thrown: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Request method failure captured: May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b HTTP/1.1 May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_5UpiK_sJu-L65bhF-W6plYexNHrhLrYB-I1cJUTO6R8OHhJMtXJfg-M1_4eTQJ_B7bxhSWFILG4eURbwEip8RiSSEIrBmeSHYqWSbeYGjmmwmYteNrT6AsdtfvaECd_WwlJJt1l5PSsmz-z2ur5T_jB3RF3ywiyKJpLfnAgR0VT0 May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:15:47.563392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1aeb238c6f4b4c67b876c966b62d3e86", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-DeleteServersTestJSON-812426952 May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 663b8de7a75342e28e9d2061efad8305 May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.567249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '80399184-6140-46b7-9089-6a315714fa4b'} May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:47.568074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.569512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.578519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Returning 404 to user: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:47.578519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-63a0a948-82eb-4d2f-9ea2-731e5813fd42 tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "DELETE /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 404 len: 111 microversion: 2.1 time: 0.040162 May 24 10:15:47.578519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 99/196] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:15:47 2022] DELETE /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:15:47.582938 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:47.583612 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] [instance: 80399184-6140-46b7-9089-6a315714fa4b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:47.590610 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:47.591349 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:47.592370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:47.593873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:47.610752 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] HTTP exception thrown: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Request method failure captured: May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b HTTP/1.1 May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_5UpiK_sJu-L65bhF-W6plYexNHrhLrYB-I1cJUTO6R8OHhJMtXJfg-M1_4eTQJ_B7bxhSWFILG4eURbwEip8RiSSEIrBmeSHYqWSbeYGjmmwmYteNrT6AsdtfvaECd_WwlJJt1l5PSsmz-z2ur5T_jB3RF3ywiyKJpLfnAgR0VT0 May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:15:47.612301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1aeb238c6f4b4c67b876c966b62d3e86", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1aeb238c6f4b4c67b876c966b62d3e86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-DeleteServersTestJSON-812426952 May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 1aeb238c6f4b4c67b876c966b62d3e86 May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-DeleteServersTestJSON-812426952 May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 663b8de7a75342e28e9d2061efad8305 May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-DeleteServersTestJSON-812426952-project May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.616046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '80399184-6140-46b7-9089-6a315714fa4b'} May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:47.617598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. May 24 10:15:47.618802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:47.621580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] Returning 404 to user: Instance 80399184-6140-46b7-9089-6a315714fa4b could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:47.621580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9c347976-36c0-440d-95c2-adba10979c0a tempest-DeleteServersTestJSON-812426952 tempest-DeleteServersTestJSON-812426952-project] 10.222.0.44 "GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b" status: 404 len: 111 microversion: 2.1 time: 0.037658 May 24 10:15:47.621580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 100/197] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:47 2022] GET /compute/v2.1/servers/80399184-6140-46b7-9089-6a315714fa4b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:15:47.698391 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:47.707255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ffb610f0-f59f-488a-941b-7ab92946178f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.225025 May 24 10:15:47.707821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 98/198] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:47 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:48.731555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:48.732180 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:48.741010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:48.742085 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:48.743479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:48.744035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:48.953772 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:48.962923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f98fbe05-dd4a-49af-a9b0-cb9a3c36c632 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.236303 May 24 10:15:48.963501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 101/199] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:48 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:49.979694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:49.980441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:49.987650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:49.991147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:49.991147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:49.991147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:50.127775 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:50.140617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e99b53b5-3d5c-40eb-9846-89768c5789dd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.163972 May 24 10:15:50.141203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 99/200] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:49 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:50.980555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8f2988a5-b706-4817-9148-e4d093743125 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Action: 'create', calling method: .version_select at 0x7ff640162430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-197199562", "metadata": {"Type": "work"}}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8f2988a5-b706-4817-9148-e4d093743125 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Request method failure captured: May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 121 May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLBWAN-cZjWYVZwUHDrWVpKpR-KULJzjlfKUpoPrVOQ86BWzXDHVusAXPg8zRYaIbR1TXDsDq6IWq9yoZaUE8U9bJfiWBfteNXveRTGDM79wMeBl1ZZX767-7pnqawkeAgvL3s6xSoQs--JF7bIrRN-R7ejm72hZBnx89pRuboBIEgA May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:15:50.987392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a7fb5f2c32174d5082735110fdf8e8c4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesNegativeTest-1773558790 May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 379758250b684531bc0bcc3ba3055321 May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-197199562", "metadata": {"Type": "work"}}} May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: May 24 10:15:50.988894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-197199562', 'metadata': {'Type': 'work'}}}} May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise error May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi '#$%' May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:50.990048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 10:15:50.991613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 10:15:50.994144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 24 10:15:50.994144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:50.994144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8f2988a5-b706-4817-9148-e4d093743125 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:50.994144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8f2988a5-b706-4817-9148-e4d093743125 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.245010 May 24 10:15:50.994144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 102/201] 10.222.0.44 () {60 vars in 1155 bytes} [Tue May 24 10:15:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 10:15:50.998308 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3e72ffea-cbf7-4b7a-8afc-0009c103e0aa tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Action: 'create', calling method: .version_select at 0x7ff6403c4f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1447819469", "metadata": {"Type": "work"}}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3e72ffea-cbf7-4b7a-8afc-0009c103e0aa tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Request method failure captured: May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 120 May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLBWAN-cZjWYVZwUHDrWVpKpR-KULJzjlfKUpoPrVOQ86BWzXDHVusAXPg8zRYaIbR1TXDsDq6IWq9yoZaUE8U9bJfiWBfteNXveRTGDM79wMeBl1ZZX767-7pnqawkeAgvL3s6xSoQs--JF7bIrRN-R7ejm72hZBnx89pRuboBIEgA May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:15:51.001509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a7fb5f2c32174d5082735110fdf8e8c4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 379758250b684531bc0bcc3ba3055321 May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1447819469", "metadata": {"Type": "work"}}} May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: May 24 10:15:51.003420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1447819469', 'metadata': {'Type': 'work'}}}} May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise error May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi '0' May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:51.004409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 10:15:51.006039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 10:15:51.007319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 24 10:15:51.007319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.007319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3e72ffea-cbf7-4b7a-8afc-0009c103e0aa tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:51.007319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3e72ffea-cbf7-4b7a-8afc-0009c103e0aa tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009021 May 24 10:15:51.007319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 100/202] 10.222.0.44 () {60 vars in 1155 bytes} [Tue May 24 10:15:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 24 10:15:51.012423 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d9193eca-f5bc-46fd-8395-d0bad6432725 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Action: 'create', calling method: .version_select at 0x7ff6414159d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-634026526", "metadata": {"Type": "work"}}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d9193eca-f5bc-46fd-8395-d0bad6432725 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Request method failure captured: May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 118 May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLBWAN-cZjWYVZwUHDrWVpKpR-KULJzjlfKUpoPrVOQ86BWzXDHVusAXPg8zRYaIbR1TXDsDq6IWq9yoZaUE8U9bJfiWBfteNXveRTGDM79wMeBl1ZZX767-7pnqawkeAgvL3s6xSoQs--JF7bIrRN-R7ejm72hZBnx89pRuboBIEgA May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:15:51.014742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a7fb5f2c32174d5082735110fdf8e8c4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 379758250b684531bc0bcc3ba3055321 May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-634026526", "metadata": {"Type": "work"}}} May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: May 24 10:15:51.016158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-634026526', 'metadata': {'Type': 'work'}}}} May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise error May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi On instance['volume']: May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi '' May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:51.017126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 24 10:15:51.019239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 24 10:15:51.020823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 24 10:15:51.020823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.020823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d9193eca-f5bc-46fd-8395-d0bad6432725 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:51.020823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d9193eca-f5bc-46fd-8395-d0bad6432725 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007491 May 24 10:15:51.020823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 103/203] 10.222.0.44 () {60 vars in 1155 bytes} [Tue May 24 10:15:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 24 10:15:51.025600 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4fc86eac-b991-4e71-9743-d705b25c1642 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Calling method '.version_select at 0x7ff640171a60>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:51.053830 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-4fc86eac-b991-4e71-9743-d705b25c1642 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] HTTP exception thrown: Volume tempest-invalid-402864854 could not be found. May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4fc86eac-b991-4e71-9743-d705b25c1642 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Request method failure captured: May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-402864854 HTTP/1.1 May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLBWAN-cZjWYVZwUHDrWVpKpR-KULJzjlfKUpoPrVOQ86BWzXDHVusAXPg8zRYaIbR1TXDsDq6IWq9yoZaUE8U9bJfiWBfteNXveRTGDM79wMeBl1ZZX767-7pnqawkeAgvL3s6xSoQs--JF7bIrRN-R7ejm72hZBnx89pRuboBIEgA May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:15:51.059031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a7fb5f2c32174d5082735110fdf8e8c4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 379758250b684531bc0bcc3ba3055321 May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Volume tempest-invalid-402864854 could not be found. May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': 'tempest-invalid-402864854'} May 24 10:15:51.060563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-402864854 could not be found. (HTTP 404) (Request-ID: req-4d1e14d0-68a4-4a36-9429-6b3e76f6eba9) May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.061407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 10:15:51.062524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-402864854 could not be found. May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:15:51.063548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-402864854 could not be found. May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-402864854 could not be found. May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4fc86eac-b991-4e71-9743-d705b25c1642 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Returning 404 to user: Volume tempest-invalid-402864854 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4fc86eac-b991-4e71-9743-d705b25c1642 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-402864854" status: 404 len: 98 microversion: 2.1 time: 0.038544 May 24 10:15:51.065282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 101/204] 10.222.0.44 () {58 vars in 1214 bytes} [Tue May 24 10:15:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-402864854 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 24 10:15:51.072098 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-162cbb22-5d86-4873-9760-b78f95fc4c97 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005284 May 24 10:15:51.074455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 104/205] 10.222.0.44 () {58 vars in 1139 bytes} [Tue May 24 10:15:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 10:15:51.083672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cfa42ddf-c947-4bd8-8ad3-9764e2a449ce tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004548 May 24 10:15:51.084451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 102/206] 10.222.0.44 () {58 vars in 1136 bytes} [Tue May 24 10:15:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 24 10:15:51.093094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f44076ed-8d13-401b-bc5c-5291ffc4470a tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Calling method '.version_select at 0x7ff640420ca0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:51.120984 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-f44076ed-8d13-401b-bc5c-5291ffc4470a tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] HTTP exception thrown: Volume 37954542-b75d-4f18-a34b-47fdf3cfa7af could not be found. May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f44076ed-8d13-401b-bc5c-5291ffc4470a tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Request method failure captured: May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/os-volumes/37954542-b75d-4f18-a34b-47fdf3cfa7af HTTP/1.1 May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLBWAN-cZjWYVZwUHDrWVpKpR-KULJzjlfKUpoPrVOQ86BWzXDHVusAXPg8zRYaIbR1TXDsDq6IWq9yoZaUE8U9bJfiWBfteNXveRTGDM79wMeBl1ZZX767-7pnqawkeAgvL3s6xSoQs--JF7bIrRN-R7ejm72hZBnx89pRuboBIEgA May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:15:51.123023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a7fb5f2c32174d5082735110fdf8e8c4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 379758250b684531bc0bcc3ba3055321 May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Volume 37954542-b75d-4f18-a34b-47fdf3cfa7af could not be found. May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '37954542-b75d-4f18-a34b-47fdf3cfa7af'} May 24 10:15:51.124335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 37954542-b75d-4f18-a34b-47fdf3cfa7af could not be found. (HTTP 404) (Request-ID: req-168721cf-b529-413f-9584-64e43729a090) May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.125058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 10:15:51.126419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 37954542-b75d-4f18-a34b-47fdf3cfa7af could not be found. May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 10:15:51.129727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 37954542-b75d-4f18-a34b-47fdf3cfa7af could not be found. May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 37954542-b75d-4f18-a34b-47fdf3cfa7af could not be found. May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f44076ed-8d13-401b-bc5c-5291ffc4470a tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Returning 404 to user: Volume 37954542-b75d-4f18-a34b-47fdf3cfa7af could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f44076ed-8d13-401b-bc5c-5291ffc4470a tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/37954542-b75d-4f18-a34b-47fdf3cfa7af" status: 404 len: 109 microversion: 2.1 time: 0.035228 May 24 10:15:51.131285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 105/207] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:15:51 2022] DELETE /compute/v2.1/os-volumes/37954542-b75d-4f18-a34b-47fdf3cfa7af => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:15:51.136857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a8703173-dfd4-443f-8494-153dd7868019 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Calling method '.version_select at 0x7ff64024b940>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:51.157601 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:51.159072 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:51.168210 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-a8703173-dfd4-443f-8494-153dd7868019 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] HTTP exception thrown: Volume 0f7db1e2-accc-4886-b945-e41d7dffc776 could not be found. May 24 10:15:51.168312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:51.168312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:51.168312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a8703173-dfd4-443f-8494-153dd7868019 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Request method failure captured: May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/os-volumes/0f7db1e2-accc-4886-b945-e41d7dffc776 HTTP/1.1 May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLBWAN-cZjWYVZwUHDrWVpKpR-KULJzjlfKUpoPrVOQ86BWzXDHVusAXPg8zRYaIbR1TXDsDq6IWq9yoZaUE8U9bJfiWBfteNXveRTGDM79wMeBl1ZZX767-7pnqawkeAgvL3s6xSoQs--JF7bIrRN-R7ejm72hZBnx89pRuboBIEgA May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:15:51.168540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a7fb5f2c32174d5082735110fdf8e8c4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a7fb5f2c32174d5082735110fdf8e8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: a7fb5f2c32174d5082735110fdf8e8c4 May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesNegativeTest-1773558790 May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 379758250b684531bc0bcc3ba3055321 May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesNegativeTest-1773558790-project May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Volume 0f7db1e2-accc-4886-b945-e41d7dffc776 could not be found. May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '0f7db1e2-accc-4886-b945-e41d7dffc776'} May 24 10:15:51.169677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0f7db1e2-accc-4886-b945-e41d7dffc776 could not be found. (HTTP 404) (Request-ID: req-b2426617-5f0c-4939-95a2-e3a43db85f6f) May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.170398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:15:51.171628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0f7db1e2-accc-4886-b945-e41d7dffc776 could not be found. May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 10:15:51.172693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0f7db1e2-accc-4886-b945-e41d7dffc776 could not be found. May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0f7db1e2-accc-4886-b945-e41d7dffc776 could not be found. May 24 10:15:51.174234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:15:51.174933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:51.175020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a8703173-dfd4-443f-8494-153dd7868019 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] Returning 404 to user: Volume 0f7db1e2-accc-4886-b945-e41d7dffc776 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:15:51.175020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a8703173-dfd4-443f-8494-153dd7868019 tempest-VolumesNegativeTest-1773558790 tempest-VolumesNegativeTest-1773558790-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0f7db1e2-accc-4886-b945-e41d7dffc776" status: 404 len: 109 microversion: 2.1 time: 0.036599 May 24 10:15:51.175020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 103/208] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:15:51 2022] GET /compute/v2.1/os-volumes/0f7db1e2-accc-4886-b945-e41d7dffc776 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:15:51.307867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:51.316573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fb67243e-846d-4900-832e-759d298660b0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.162604 May 24 10:15:51.317148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 106/209] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:51 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:52.334649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:52.335262 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:52.342220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:52.342789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:52.343573 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:52.344044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:52.477078 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:52.492018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2a97bff3-0ec9-4baf-8996-68af88f928df tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.158535 May 24 10:15:52.492018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 104/210] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:52 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:53.505828 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:53.506443 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:53.513043 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:53.513508 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:53.517330 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:53.517330 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:53.647414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:53.654925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c8d3746a-a85f-4554-8fb1-0c2824a8bf9b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.153136 May 24 10:15:53.655496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 107/211] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:53 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:54.673505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:54.674101 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:54.681676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:54.682119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:54.682883 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:54.683490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:54.813027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:54.821313 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-feb06af0-7120-4cbb-8804-90423f338541 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.152474 May 24 10:15:54.821809 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 105/212] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:54 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:15:55.839052 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:55.839776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:55.846876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:55.847398 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:55.848286 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:55.848955 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:55.985652 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:55.994717 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9c02c972-b2b2-4ecd-ac09-52f71d5bbf1f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.160719 May 24 10:15:55.995336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 108/213] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:55 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:57.015006 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:57.015006 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:57.018752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:57.019208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:57.020001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:57.020434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:57.151661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:57.159255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4b9ea161-b43b-46fd-b7a1-4ae18673ef85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.151047 May 24 10:15:57.170986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 106/214] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:57 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:58.176710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:58.177289 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:58.183972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:58.184420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:58.189079 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:58.189079 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:58.326580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:58.336692 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7d11dec3-f92d-417b-81fe-ffb281917ccb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1522 microversion: 2.1 time: 0.163471 May 24 10:15:58.336921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 109/215] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:58 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:59.354722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:59.355390 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:59.361626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:59.362074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:59.362862 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:59.363285 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:59.502103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:59.510279 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-16325e2d-011f-4a34-8514-82a8143b3847 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1502 microversion: 2.1 time: 0.160594 May 24 10:15:59.511127 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 107/216] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:59 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:15:59.532626 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:15:59.533217 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:15:59.540400 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:59.540829 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:59.541749 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:15:59.542280 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:15:59.678815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:15:59.686575 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ddce3aff-4b9b-4dc5-bd8c-162efdb58622 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1516 microversion: 2.1 time: 0.157569 May 24 10:15:59.687254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 110/217] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:15:59 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:01.435220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:01.436272 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:01.442725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:01.444234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:01.445462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:01.446107 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:01.470947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lazy-loading 'flavor' on Instance uuid ee5360b6-0f14-4294-b939-f78a1edf56e5 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:16:01.807550 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4d0ef807-1a0d-486f-a1b0-3029ba7b5369 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5/action" status: 200 len: 32 microversion: 2.1 time: 0.376392 May 24 10:16:01.808490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 108/218] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:16:01 2022] POST /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:16:01.821656 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:01.822414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:01.835708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:01.844151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:01.844151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:01.844151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:02.008118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:02.017618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-76204ebc-b3e5-4a4d-abd8-959ce35fba32 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.200083 May 24 10:16:02.034663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 111/219] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:01 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:03.041791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:03.042565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:03.048971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:03.049779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:03.050709 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:03.051146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:03.208314 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:03.216881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6c96d5cb-c4d3-4548-9174-dfe8249bc2cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.179132 May 24 10:16:03.217770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 109/220] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:03 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:04.234932 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:04.235479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:04.242725 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:04.243167 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:04.243946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:04.244374 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:04.372970 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:04.380565 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d565511c-c1f7-4feb-bbf7-f8e8c59938a8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.149543 May 24 10:16:04.381231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 112/221] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:04 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:05.397294 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:05.397892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:05.403986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:05.404440 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:05.405205 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:05.405649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:05.409658 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:05.561612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:05.570143 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3acaee94-5ae5-4a8e-85d4-d218b5e40139 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.177086 May 24 10:16:05.570704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 110/222] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:05 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:06.587831 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:06.588998 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:06.596631 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:06.596631 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:06.597147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:06.597799 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:06.744074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:06.751903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-886f9ae5-56ec-4a20-b785-c0cf745b322b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.168918 May 24 10:16:06.752475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 113/223] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:06 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:07.767744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:07.768303 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:07.775695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:07.776180 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:07.777314 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:07.777411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:07.926692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:07.935689 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e8218975-96fe-4191-987c-8ca5d8b4f4f4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.171772 May 24 10:16:07.944868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 111/224] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:07 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:08.953491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:08.954160 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:08.960823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:08.961328 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:08.962080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:08.962505 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:09.100158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:09.107579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bfbb6096-853e-4991-9d7e-d3124c2c902a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.158205 May 24 10:16:09.108110 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 114/225] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:08 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:10.125983 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:10.126448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:10.133219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:10.133667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:10.134434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:10.134863 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:10.309172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:10.316652 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-458d7a71-76eb-4d31-8501-ff5c0e836ab6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.195767 May 24 10:16:10.317216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 112/226] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:10 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:11.334602 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:11.335211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:11.342384 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:11.342889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:11.343660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:11.344125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:11.475244 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:11.482635 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d53a882b-e1d6-4fc0-a681-db9fd2f73afa tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.152572 May 24 10:16:11.483190 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 115/227] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:11 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:12.500208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:12.500813 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:12.506972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:12.507417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:12.508215 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:12.508745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:12.634199 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:12.641749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6a46adf8-2709-4fe3-aeda-50bef9089af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.145347 May 24 10:16:12.642308 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 113/228] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:12 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:13.658704 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:13.659508 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:13.666207 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:13.666685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:13.667441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:13.667972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:13.799744 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:13.807470 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a05d0c19-074f-4711-98b4-a578d40378d0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.152767 May 24 10:16:13.808099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 116/229] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:13 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:14.824582 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:14.825273 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:14.827173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=34 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:14.832971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:14.833660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:14.834648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:14.835081 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:14.970599 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:14.979277 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-95e46d60-a3aa-4113-9541-757eb808692a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.158604 May 24 10:16:14.979951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 114/230] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:14 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:15.996173 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:15.996777 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:15.999165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=36 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:16.004435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:16.005054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:16.006018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:16.013498 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:16.146588 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:16.154590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f464fcd4-c20e-4b69-9f77-5c667f2cbf59 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.161762 May 24 10:16:16.155125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 117/231] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:15 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:17.172681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:17.173537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:17.181023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:17.181554 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:17.182443 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:17.182954 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:17.332765 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:17.341026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-910d764f-1f01-4f9d-a31c-9b1a32c4d78a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.172980 May 24 10:16:17.341585 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 115/232] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:17 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:18.358009 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:18.358647 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:18.365137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:18.365583 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:18.367033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:18.367493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:18.370018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=89 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:18.493967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:18.501361 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-62a047ab-7632-4232-890a-7c6d5f0f0498 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.147227 May 24 10:16:18.502028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 118/233] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:18 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:19.518758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:19.519389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:19.526168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:19.526622 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:19.527375 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:19.527827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:19.657291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:19.666033 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0ad79891-ebdd-4c94-ae49-5a239dba82b7 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.151103 May 24 10:16:19.666755 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 116/234] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:19 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:20.684396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:20.685797 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:20.693053 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:20.693500 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:20.694358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:20.694841 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:20.825645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:20.833421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d1fa7b36-d488-47fb-85aa-67f5a0dd6c2e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.152842 May 24 10:16:20.834121 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 119/235] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:20 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:21.852699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:21.857812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:21.859162 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:21.859603 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:21.860397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:21.860837 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:21.987607 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:21.995831 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b80dae1e-f738-4243-bed8-c670ec7e5506 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.147411 May 24 10:16:21.996946 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 117/236] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:21 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:23.011827 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:23.012432 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:23.018811 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:23.019251 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:23.020051 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:23.020476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:23.158414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:23.166480 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-08b319be-2203-4906-97ed-4d9228c20075 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.158489 May 24 10:16:23.167046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 120/237] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:23 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:24.183169 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:24.183745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:24.189798 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:24.190234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:24.190976 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:24.191399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:24.317572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:24.325688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e61a141e-a19f-4f5c-bfc7-8370a555d213 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.146400 May 24 10:16:24.326267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 118/238] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:24 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:25.342131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:25.342734 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:25.349279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:25.349753 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:25.350510 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:25.350941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:25.479346 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:25.486744 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d35b4055-0efe-4992-9e88-3c6c56308e33 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.148349 May 24 10:16:25.491662 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 121/239] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:25 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:25.914360 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5679ac25-4efe-4249-a1df-2795e0d46f05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:25.914912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5679ac25-4efe-4249-a1df-2795e0d46f05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:25.920799 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5679ac25-4efe-4249-a1df-2795e0d46f05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:25.921239 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5679ac25-4efe-4249-a1df-2795e0d46f05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:25.921989 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5679ac25-4efe-4249-a1df-2795e0d46f05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:25.922444 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5679ac25-4efe-4249-a1df-2795e0d46f05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:25.946146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5679ac25-4efe-4249-a1df-2795e0d46f05 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/ips" status: 200 len: 146 microversion: 2.1 time: 0.036072 May 24 10:16:25.946704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 119/240] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:16:25 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:16:26.504583 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:26.505219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:26.511857 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:26.512312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:26.513068 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:26.513496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:26.642023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:26.649761 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-75b34c30-4f16-4e68-8c30-49713143b4eb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.148987 May 24 10:16:26.655547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 122/241] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:26 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:26.921206 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b5f113a-9ac8-450e-a32e-1bd39bc50aaa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:26.921765 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4b5f113a-9ac8-450e-a32e-1bd39bc50aaa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:26.927685 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b5f113a-9ac8-450e-a32e-1bd39bc50aaa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:26.928975 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b5f113a-9ac8-450e-a32e-1bd39bc50aaa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:26.929748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b5f113a-9ac8-450e-a32e-1bd39bc50aaa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:26.930184 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b5f113a-9ac8-450e-a32e-1bd39bc50aaa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:26.954648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4b5f113a-9ac8-450e-a32e-1bd39bc50aaa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/ips" status: 200 len: 150 microversion: 2.1 time: 0.037182 May 24 10:16:26.955277 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 120/242] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:16:26 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:16:27.667022 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:27.668213 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:27.674709 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:27.675163 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:27.677611 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:27.677611 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:27.812140 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:27.820712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-18009fe5-ff8d-4b2d-b120-94572f9ec77e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.158243 May 24 10:16:27.821279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 123/243] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:27 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:28.838147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:28.838753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:28.844580 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:28.845026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:28.845779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:28.846215 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.196895 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:29.204469 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b21e1c49-2b20-4059-b69f-0b51cd81cdd9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1502 microversion: 2.1 time: 0.370859 May 24 10:16:29.209217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 121/244] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:28 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1502 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:29.225828 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5ae127b-dbd8-42f2-9273-71ce5ecc9106"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:29.227100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:29.233934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.234383 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.235432 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.235845 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.274521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] HTTP exception thrown: Cannot 'attach_volume' instance ee5360b6-0f14-4294-b939-f78a1edf56e5 while it is in vm_state rescued May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Request method failure captured: May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: POST /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5/os-volume_attachments HTTP/1.1 May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 74 May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_8tQi6wMxPCTc3pS2gwEbfG2aOiCJ01U6sf1SmGdU5szWloH5BU1k2nT4FISfY1tg_KZcBZ0N60ytyG7xNeF2_bRfGTo3syuKWH61tulbcqp789BMMnsv5DCeYdFwqr_1IIiLi6gklaukfv7nSQYCZPTJxZ7HAFVrC-cdLyhFTw7w May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:16:29.276800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_544ebc06855b4435b767c0cc885ec068", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 04058cb7cf374eba92fb7ee796084e20 May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {"volumeAttachment": {"volumeId": "f5ae127b-dbd8-42f2-9273-71ce5ecc9106"}} May 24 10:16:29.278133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Cannot 'attach_volume' instance ee5360b6-0f14-4294-b939-f78a1edf56e5 while it is in vm_state rescued May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'server_id': 'ee5360b6-0f14-4294-b939-f78a1edf56e5', 'body': {'volumeAttachment': {'volumeId': 'f5ae127b-dbd8-42f2-9273-71ce5ecc9106'}}} May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee5360b6-0f14-4294-b939-f78a1edf56e5 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:16:29.278892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee5360b6-0f14-4294-b939-f78a1edf56e5 while it is in vm_state rescued May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:16:29.283097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:16:29.284208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:16:29.284208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:16:29.284208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee5360b6-0f14-4294-b939-f78a1edf56e5 while it is in vm_state rescued May 24 10:16:29.284208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:16:29.284208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Returning 409 to user: Cannot 'attach_volume' instance ee5360b6-0f14-4294-b939-f78a1edf56e5 while it is in vm_state rescued {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:16:29.284208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e6d5f905-de82-4d8c-ab13-58c5364f88ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.060209 May 24 10:16:29.284208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 124/245] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:16:29 2022] POST /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 10:16:29.291392 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3975d5fc-ea6e-4478-ac06-a8489beb9fa4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:29.291954 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3975d5fc-ea6e-4478-ac06-a8489beb9fa4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:29.298400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3975d5fc-ea6e-4478-ac06-a8489beb9fa4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.299176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3975d5fc-ea6e-4478-ac06-a8489beb9fa4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.299971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3975d5fc-ea6e-4478-ac06-a8489beb9fa4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.300562 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3975d5fc-ea6e-4478-ac06-a8489beb9fa4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.309736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1b89e3e3-a558-4b45-b026-0414fa9cd287 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbd13b65-a6a1-4510-b552-be876933450b"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:29.310791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1b89e3e3-a558-4b45-b026-0414fa9cd287 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:29.316978 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b89e3e3-a558-4b45-b026-0414fa9cd287 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.317430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b89e3e3-a558-4b45-b026-0414fa9cd287 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.318194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b89e3e3-a558-4b45-b026-0414fa9cd287 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.318692 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b89e3e3-a558-4b45-b026-0414fa9cd287 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.672835 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3975d5fc-ea6e-4478-ac06-a8489beb9fa4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5/action" status: 202 len: 0 microversion: 2.1 time: 0.385625 May 24 10:16:29.678739 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 122/246] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:16:29 2022] POST /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:16:29.685097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:29.686037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:29.692664 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.693112 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.693951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:29.694389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:29.821230 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:29.829501 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fe1eed2f-e3ec-4c8b-8d68-7d0d0aaf632b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1510 microversion: 2.1 time: 0.151171 May 24 10:16:29.830140 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 123/247] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:29 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:30.448132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1b89e3e3-a558-4b45-b026-0414fa9cd287 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.142013 May 24 10:16:30.449966 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 125/248] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:16:29 2022] POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:16:30.788679 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d36bab68-2714-4058-989c-d672bc766aeb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f242c51-f46a-4ca7-8310-7dcd20f5cda1"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:30.790380 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d36bab68-2714-4058-989c-d672bc766aeb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:30.796568 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d36bab68-2714-4058-989c-d672bc766aeb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:30.797020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d36bab68-2714-4058-989c-d672bc766aeb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:30.797783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d36bab68-2714-4058-989c-d672bc766aeb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:30.798257 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d36bab68-2714-4058-989c-d672bc766aeb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:30.849475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:30.849475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:30.857560 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:30.857997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:30.858763 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:30.859192 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:31.016715 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:31.024880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-99d506c4-9c50-4bd3-adfe-f99fde4fbe85 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1510 microversion: 2.1 time: 0.181726 May 24 10:16:31.027360 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 126/249] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:30 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1510 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:32.042936 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:32.043556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:32.049904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:32.050360 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:32.051103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:32.051528 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:32.181786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:32.186522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f87bce58-c63a-4832-9bd9-face65ed6c35 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1510 microversion: 2.1 time: 0.147413 May 24 10:16:32.187095 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 127/250] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:32 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:33.203042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:33.203714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:33.210903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:33.211358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:33.216823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:33.217359 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:33.356255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:33.363738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-37244cf7-ce20-4b18-899d-d1ffd7b7b39a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1510 microversion: 2.1 time: 0.164878 May 24 10:16:33.364364 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 128/251] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:33 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:33.817501 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d36bab68-2714-4058-989c-d672bc766aeb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.032663 May 24 10:16:33.818145 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 124/252] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:16:30 2022] POST /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments => generated 194 bytes in 3034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:16:34.380573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:34.381817 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:34.388370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:34.388757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:34.389503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:34.389937 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:34.520255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:34.527788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-69376213-026a-4f23-a81d-38c744f7d9e9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1510 microversion: 2.1 time: 0.150962 May 24 10:16:34.528380 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 129/253] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:34 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:35.546245 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:35.546933 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:35.554405 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:35.554845 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:35.555605 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:35.556074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:35.560022 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:35.686157 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:35.693796 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-65c2d265-1e4c-4bd6-a9e0-2fdfc5accbda tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1510 microversion: 2.1 time: 0.152220 May 24 10:16:35.694456 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 125/254] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:35 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:36.710621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:36.711196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:36.717805 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:36.718256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:36.719015 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:36.719442 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:36.848002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:36.856379 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-35eb3957-b03f-402b-b8ee-23dbc12ce75f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1510 microversion: 2.1 time: 0.150411 May 24 10:16:36.856947 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 130/255] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:36 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:37.872674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:37.873288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:37.880017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:37.880466 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:37.881257 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:37.881688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:38.016905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:38.025398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1f9c5953-de7d-41be-9978-2a6f43a5b4fe tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1516 microversion: 2.1 time: 0.156482 May 24 10:16:38.025964 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 126/256] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:37 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:39.779448 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ffb47785-3cfe-4536-b836-ec584ee52d6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'create', calling method: .version_select at 0x7ff640162c10>, body: {"keypair": {"name": "tempest-keypair-1085875032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEV4TiHx+v0nj082rAVXZJVPPq6wMxKQrVtbaEK4nu/5IbqUCmH6l3G/txCmyHBbd/ywxXC89NNAgdOY2nh4/7JCbSzOy2JdrKV5RaF/BIaizAp16JrpPuWBwj6Fl9yydQ=="}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:39.799450 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-ffb47785-3cfe-4536-b836-ec584ee52d6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for project 544ebc06855b4435b767c0cc885ec068. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:16:39.803364 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-ffb47785-3cfe-4536-b836-ec584ee52d6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for user 04058cb7cf374eba92fb7ee796084e20 and project 544ebc06855b4435b767c0cc885ec068. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:16:39.901479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ffb47785-3cfe-4536-b836-ec584ee52d6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125707 May 24 10:16:39.902090 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 131/257] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:16:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:16:42.347582 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-333929148", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8587c97f-8883-4d0e-9495-da500acecb33"}], "security_groups": [{"name": "tempest-securitygroup--84237655"}], "key_name": "tempest-keypair-1085875032", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:42.452175 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] validate_networks() for [('8587c97f-8883-4d0e-9495-da500acecb33', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:16:42.826793 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:16:42.827237 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:16:42.827733 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:16:42.828164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:16:42.828574 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:16:42.837893 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:42.838439 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:42.839181 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:42.839695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:42.857852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for project 544ebc06855b4435b767c0cc885ec068. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:16:42.861713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Getting quotas for user 04058cb7cf374eba92fb7ee796084e20 and project 544ebc06855b4435b767c0cc885ec068. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:16:42.873019 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:16:42.876532 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:16:43.011754 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b4dcd9cd-38e2-4d5d-abbb-5c7601b52e54 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.668965 May 24 10:16:43.012346 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 127/258] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:16:42 2022] POST /compute/v2.1/servers => generated 407 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:16:43.023343 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0527df79-1ae8-4096-a592-768d43f62c42 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:43.023998 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0527df79-1ae8-4096-a592-768d43f62c42 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:43.080920 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0527df79-1ae8-4096-a592-768d43f62c42 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:43.089707 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0527df79-1ae8-4096-a592-768d43f62c42 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1245 microversion: 2.1 time: 0.071149 May 24 10:16:43.100379 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 132/259] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:43 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:44.108560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:44.109095 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:44.115339 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:44.115823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:44.116563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:44.116995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:44.179500 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:44.186977 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a2dfd85c-d222-4954-86e9-ae87b6c2856a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1249 microversion: 2.1 time: 0.082853 May 24 10:16:44.187539 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 128/260] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:44 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1249 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:45.209440 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:45.211186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:45.217825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:45.218271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:45.219041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:45.219476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:45.281746 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:45.290141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c7d60e40-7233-43b0-bb8f-96f0d5a13bcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1249 microversion: 2.1 time: 0.087762 May 24 10:16:45.290807 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 133/261] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:45 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:46.307576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:46.308384 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:46.310725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:46.315545 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:46.316023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:46.316788 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:46.317589 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:46.381812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:46.389232 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1649f208-2221-4934-9cb4-3f18ea19fe3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1297 microversion: 2.1 time: 0.086637 May 24 10:16:46.389794 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 129/262] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:46 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:46.731602 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-dbaba5fa-b9f2-46e6-9f15-6076ba38206b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:46.735708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:46.741485 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dbaba5fa-b9f2-46e6-9f15-6076ba38206b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:46.742149 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dbaba5fa-b9f2-46e6-9f15-6076ba38206b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:46.811288 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-dbaba5fa-b9f2-46e6-9f15-6076ba38206b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Going to try to stop instance {{(pid=118130) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 10:16:46.954741 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:47.097115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-dbaba5fa-b9f2-46e6-9f15-6076ba38206b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action" status: 202 len: 0 microversion: 2.1 time: 0.369516 May 24 10:16:47.097826 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 134/263] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:16:46 2022] POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:16:47.105986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:47.106583 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:47.115306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:47.115989 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:47.117335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:47.117936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:47.305287 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:47.314693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dfd8ee97-0f68-4776-b563-124cc4049083 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.212572 May 24 10:16:47.322503 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 130/264] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:47 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:47.407391 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:47.408111 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:47.415549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:47.416023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:47.420981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:47.420981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:47.487064 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:47.495333 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e4de963a-00c8-47d1-b2a1-4f2c6add0cde tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1303 microversion: 2.1 time: 0.092585 May 24 10:16:47.496075 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 135/265] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:47 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:48.334603 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:48.335572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:48.342664 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:48.343464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:48.344597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:48.345258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:48.520687 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:48.521292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:48.533754 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:48.545457 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a6233903-c231-4693-abd4-3d7fde0a4d31 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.215480 May 24 10:16:48.548364 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 131/266] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:48 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:48.557250 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:48.559002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:48.560146 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:48.560961 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:48.707660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:48.715432 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-692cb286-3582-471c-bd71-29d01c4f0af9 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.201254 May 24 10:16:48.716034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 136/267] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:48 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:49.167058 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-b51daf00-ce97-4133-95bb-72ae83110137 req-ad1376f8-ea65-4e38-8155-0879265b5b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1977a5eb-902f-4527-8f10-5906b15eb26b", "tag": "3fc5ecd2-f964-4265-a360-ea772ea058f1"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:49.181821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b51daf00-ce97-4133-95bb-72ae83110137 req-ad1376f8-ea65-4e38-8155-0879265b5b9b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:49.182258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b51daf00-ce97-4133-95bb-72ae83110137 req-ad1376f8-ea65-4e38-8155-0879265b5b9b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:49.200228 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-b51daf00-ce97-4133-95bb-72ae83110137 req-ad1376f8-ea65-4e38-8155-0879265b5b9b service nova] Creating event network-changed:3fc5ecd2-f964-4265-a360-ea772ea058f1 for instance 1977a5eb-902f-4527-8f10-5906b15eb26b on hv-cinder-81045 May 24 10:16:49.205417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-b51daf00-ce97-4133-95bb-72ae83110137 req-ad1376f8-ea65-4e38-8155-0879265b5b9b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048122 May 24 10:16:49.207965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 132/268] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:16:49.567166 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:49.567777 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:49.575878 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:49.576475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:49.577254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:49.577695 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:49.714708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:49.723068 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0008262e-4b3e-4766-9ec9-d8bfe658ec1f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.160624 May 24 10:16:49.732767 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 137/269] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:49 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:49.733988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:49.734670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:49.741603 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:49.742738 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:49.743298 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:49.743731 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:49.897051 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:49.904770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a369bd80-22ab-4d8b-a141-b916fa3745ae tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.176222 May 24 10:16:49.914140 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 133/270] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:49 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:50.740078 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:50.740720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:50.747400 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:50.747879 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:50.748695 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:50.755710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:50.887730 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:50.895760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8b58bbf2-094c-4ad4-b609-cbba49e6e6f1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.160328 May 24 10:16:50.896481 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 138/271] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:50 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:50.922562 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:50.923164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:50.930277 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:50.930660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:50.931419 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:50.931882 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:51.086892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:51.094970 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4b3f8b8f-f98d-4f36-9687-36015c8c6fc3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.176259 May 24 10:16:51.095546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 134/272] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:50 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:51.914550 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:51.915176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:51.921787 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:51.922234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:51.922997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:51.923429 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:52.065200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:52.074237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-143b02fc-abbb-430d-a29a-8b86e4304780 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.163742 May 24 10:16:52.076095 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 139/273] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:51 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:52.123929 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:52.125123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:52.132103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:52.172742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:52.172742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:52.172742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:52.289996 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:52.297585 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f06bcea6-d51e-45de-bc99-c5e5dbaf67f8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.180227 May 24 10:16:52.298151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 135/274] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:52 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:53.092817 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:53.093408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:53.097318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=6 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:53.103337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:53.103810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:53.104578 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:53.105084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:53.306776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:53.315695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:53.317042 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:53.317806 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cbb92b1c-4921-41e9-a5ad-769d07414cb0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.229950 May 24 10:16:53.319692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:53.320444 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:16:53.325804 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:53.326317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:53.327213 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:53.335847 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:53.338653 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 140/275] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:53 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:53.479820 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:53.487536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3eb58d4b-6fd2-4afd-9618-2e9c38724db5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.176102 May 24 10:16:53.494045 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 136/276] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:53 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:54.337222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:54.337826 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:54.346761 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:54.347549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:54.348673 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:54.351693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:54.504377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:54.505583 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:54.511515 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:54.512711 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:54.513160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:54.513937 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:54.514370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:54.520091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f56b9f2c-4c7f-4c59-b995-8151a47a0c29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.187239 May 24 10:16:54.520751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 141/277] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:54 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:54.710252 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:54.717834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-79a3ef23-cb86-442e-935e-aaa0310653d2 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.217282 May 24 10:16:54.718482 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 137/278] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:54 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:55.539751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:55.540589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:55.546924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:55.547496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:55.548410 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:55.548840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:55.707072 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:55.723542 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d8e4b058-f003-4afa-9768-993f58a60fe1 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.189311 May 24 10:16:55.726991 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 142/279] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:55 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:55.734721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:55.738302 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:55.744289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:55.744926 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:55.745686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:55.746109 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:55.894694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:55.903151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-88ec68ec-c5cc-451b-b3b7-ba8c2a76e314 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.172587 May 24 10:16:55.904231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 138/280] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:55 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:56.752900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:56.753497 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:56.760629 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:56.774787 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:56.774787 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:56.774787 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:56.863021 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c81e9d0c-7f47-49f7-84eb-3343b52c6f38 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: .version_select at 0x7ff640093af0>, body: {"keypair": {"name": "tempest-keypair-628963942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXQapHrmBlrfTo12Yze09OzQEAF+5OEWMuFfWAuNttRoEv55KpauBWJFZTifyN+Cvi8nRpcXnR/QuP59X6BaaL6ztPjHi/XWNhPnzCWREeGdRNFT4+W3Z+z7BO5v95Ciw=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:56.884654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-c81e9d0c-7f47-49f7-84eb-3343b52c6f38 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:16:56.889688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-c81e9d0c-7f47-49f7-84eb-3343b52c6f38 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:16:56.918100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:56.926104 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2e7dbc00-b8d9-49be-88cf-0e8b6bf9a791 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.177604 May 24 10:16:56.926695 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 143/281] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:56 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:56.931555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:56.932165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:56.937904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:56.938339 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:56.939080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:56.939507 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:57.013768 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c81e9d0c-7f47-49f7-84eb-3343b52c6f38 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161913 May 24 10:16:57.015084 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 139/282] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:16:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:16:57.091651 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:57.099010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-dc344890-19bd-467f-8617-c25c5dde990f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.171339 May 24 10:16:57.099621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 144/283] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:56 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:57.944398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:57.945070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:57.952306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:57.952688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:57.953635 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:57.954077 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:58.083012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:58.090965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2a75bdc3-9414-4fa7-b655-266f74d01c02 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.150978 May 24 10:16:58.094889 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 140/284] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:57 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:58.116039 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:58.121528 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:58.123755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:58.124217 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:58.125000 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:58.125430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:58.253690 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:58.261290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-89f12ae8-9416-4ceb-98ff-e84a65ed808b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.149079 May 24 10:16:58.261863 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 145/285] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:58 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:16:59.107914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:59.108436 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:59.114902 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:59.115358 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:59.116204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:59.116586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:59.245729 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:59.253850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-661f77da-3a10-4249-9783-a4f6d2a6396e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.149927 May 24 10:16:59.254414 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 141/286] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:59 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:59.278317 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:16:59.278971 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:16:59.285824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:59.286257 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:59.287003 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:59.287424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:59.399547 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-562711737", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b9088f5-9d8c-4699-894a-607b83cfa3db"}], "security_groups": [{"name": "tempest-securitygroup--2008203080"}], "key_name": "tempest-keypair-628963942", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:59.415897 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:16:59.423434 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-711aaa4c-31b8-443e-b93c-9f6414203a51 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.148821 May 24 10:16:59.423885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 146/287] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:16:59 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:16:59.501966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] validate_networks() for [('4b9088f5-9d8c-4699-894a-607b83cfa3db', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:16:59.811973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-7c8780fc-c15e-4960-a449-79318f6efd36 req-de5664e0-9bec-445f-a903-9cbfa77b3d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1977a5eb-902f-4527-8f10-5906b15eb26b", "name": "network-vif-plugged", "status": "completed", "tag": "3fc5ecd2-f964-4265-a360-ea772ea058f1"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:16:59.821502 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-7c8780fc-c15e-4960-a449-79318f6efd36 req-de5664e0-9bec-445f-a903-9cbfa77b3d09 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:59.821946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-7c8780fc-c15e-4960-a449-79318f6efd36 req-de5664e0-9bec-445f-a903-9cbfa77b3d09 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:59.833759 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-7c8780fc-c15e-4960-a449-79318f6efd36 req-de5664e0-9bec-445f-a903-9cbfa77b3d09 service nova] Creating event network-vif-plugged:3fc5ecd2-f964-4265-a360-ea772ea058f1 for instance 1977a5eb-902f-4527-8f10-5906b15eb26b on hv-cinder-81045 May 24 10:16:59.839430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-7c8780fc-c15e-4960-a449-79318f6efd36 req-de5664e0-9bec-445f-a903-9cbfa77b3d09 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032664 May 24 10:16:59.839999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 147/288] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:16:59.890211 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:16:59.890633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:16:59.891103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:16:59.891507 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:16:59.892022 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:16:59.906516 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:59.906968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:59.907789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:16:59.916491 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:16:59.941663 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:16:59.946332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:16:59.958196 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:16:59.960396 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:17:00.141159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-10e4698f-546a-47b7-8e3c-a3d1c9ac7f0f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746694 May 24 10:17:00.142079 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 142/289] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:16:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 24 10:17:00.152306 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-357fd116-6461-4d39-aaef-006a930e8c8e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:00.152882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-357fd116-6461-4d39-aaef-006a930e8c8e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:00.214805 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-357fd116-6461-4d39-aaef-006a930e8c8e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:00.221942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-357fd116-6461-4d39-aaef-006a930e8c8e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1240 microversion: 2.1 time: 0.073862 May 24 10:17:00.222841 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 148/290] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:00 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:00.282720 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:00.283899 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:00.297308 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:00.297852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:00.298697 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:00.299184 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:00.442327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:00.446063 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:00.446670 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:00.458029 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-444875f2-49df-4246-abe6-4e45827d136e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.181979 May 24 10:17:00.459599 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 143/291] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:00 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:00.472573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:00.473029 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:00.473823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:00.474259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:00.615867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:00.625325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cf6be881-3db7-47b4-8f4f-1f5296907ac0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.189054 May 24 10:17:00.635498 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 149/292] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:00 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:01.057841 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-238391614", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "networks": [{"uuid": "fa1c8a15-069f-45cb-9d6e-331677f096dc"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:01.109431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] validate_networks() for [('fa1c8a15-069f-45cb-9d6e-331677f096dc', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:17:01.238934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:01.239672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:01.253903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.254355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.255145 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.255555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.373934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:01.381989 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9ee8544c-9088-4ac2-a693-e5a1dd1ad9a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1244 microversion: 2.1 time: 0.146968 May 24 10:17:01.387869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 150/293] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:01 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1244 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:01.475923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:01.477077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:01.483954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.484503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.485411 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.485912 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.515062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:17:01.515616 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:17:01.516027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:17:01.520015 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:17:01.520015 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:17:01.525981 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.526423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.527234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.527903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.547516 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Getting quotas for project 9a065f21900943bc8cc9b0e20e0c2438. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:17:01.551885 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Getting quotas for user 042d1d8fd1174df581c464239dc7f36e and project 9a065f21900943bc8cc9b0e20e0c2438. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:17:01.565728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:17:01.567876 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:17:01.627429 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:01.636463 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6b6a107b-e0f3-4eef-8b8b-2ce20f7fbf7e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.164579 May 24 10:17:01.646271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 151/294] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:01 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:01.646271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:01.646271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:01.650064 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.650615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.651409 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:01.651965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:01.698287 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c8ec0412-1e9e-4c28-939d-8715426b830f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644734 May 24 10:17:01.698935 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 144/295] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:17:01.709275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a14a6671-d7bf-46ff-aa60-864d729ed7da tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:01.710328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a14a6671-d7bf-46ff-aa60-864d729ed7da tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:01.779830 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a14a6671-d7bf-46ff-aa60-864d729ed7da tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:01.790827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a14a6671-d7bf-46ff-aa60-864d729ed7da tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1213 microversion: 2.1 time: 0.085196 May 24 10:17:01.791630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 145/296] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:01 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:01.838774 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:01.845977 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7c7752e9-b6d9-4fac-9bad-257d377cf5a3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.207587 May 24 10:17:01.846699 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 152/297] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:01 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:02.399516 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:02.400619 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:02.407743 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.411347 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.411347 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.411347 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.425524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:02.475315 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:02.483845 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b4241a44-3c80-4e79-82e8-4d9a0f174937 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1236 microversion: 2.1 time: 0.088637 May 24 10:17:02.484405 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 146/298] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:02 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:02.654381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:02.654982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:02.661424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.661872 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.662630 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.663058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.667008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:02.790806 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:02.799526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0dfa9068-6e54-46a7-8fa8-07cf015f2dd6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.149098 May 24 10:17:02.800196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 153/299] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:02 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:02.807746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:02.808398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:02.814749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.815217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.816062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.816499 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.863298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:02.864044 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:02.870655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.871218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.872017 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:02.872462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:02.879298 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:02.887173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8b188fda-a052-429c-9d7c-af3cb538a919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1217 microversion: 2.1 time: 0.083570 May 24 10:17:02.888159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 147/300] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:02 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:02.998409 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:03.005882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f8fa6f5c-bbfa-42af-bc07-dcfd29f5f616 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.146402 May 24 10:17:03.006438 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 154/301] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:02 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:03.508695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:03.509294 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:03.515868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:03.516320 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:03.517090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:03.517533 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:03.577597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:03.585353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9c827481-8772-436c-9de0-c9d043170875 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1236 microversion: 2.1 time: 0.080526 May 24 10:17:03.585905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 148/302] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:03 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:03.818836 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:03.819443 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:03.826803 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:03.827258 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:03.828050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:03.828493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:03.904077 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:03.904680 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:03.910619 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:03.911064 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:03.911894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:03.912326 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:03.982937 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:03.987618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:03.990248 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-47b6356d-d530-4d91-9949-06c858e6408d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1217 microversion: 2.1 time: 0.090131 May 24 10:17:03.991003 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 149/303] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:03 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:03.995868 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c7cd0d42-41c1-4c16-aa5b-f6ef8ca51fc3 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.180697 May 24 10:17:03.996436 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 155/304] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:03 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:04.022346 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:04.023515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:04.029443 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:04.029891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:04.030643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:04.031077 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:04.154092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:04.161345 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b2a88a61-3c20-4053-897d-8060aae9835a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1369 microversion: 2.1 time: 0.142771 May 24 10:17:04.161911 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 150/305] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:04 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1369 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:04.602825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:04.603428 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:04.609432 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:04.613755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:04.613755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:04.613755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:04.674557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:04.681888 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-99a46967-28ca-4391-b7bc-364f71215b97 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1236 microversion: 2.1 time: 0.083717 May 24 10:17:04.682458 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 156/306] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:04 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:05.006244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:05.007170 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:05.013160 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:05.013757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:05.015478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.015950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.016730 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.017175 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.020115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.020563 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.021314 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.021743 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.090115 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:05.098025 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8f35b080-fa98-4d88-9783-ad4a362b0ed8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1217 microversion: 2.1 time: 0.095513 May 24 10:17:05.098826 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 151/307] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:05 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:05.178373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:05.178982 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:05.186527 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:05.192354 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.192804 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.193832 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.194430 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.196214 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d42012ce-e545-49c1-a1cb-731510026c0b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.186679 May 24 10:17:05.196785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 157/308] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:05 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:05.334152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:05.341514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cb6c48c4-b205-4ef6-ab15-4d94911a1ab0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1564 microversion: 2.1 time: 0.167034 May 24 10:17:05.346139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 152/309] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:05 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:05.358685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c7951083-5c75-42de-9321-f88307e47a13 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:05.359169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c7951083-5c75-42de-9321-f88307e47a13 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:05.365304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7951083-5c75-42de-9321-f88307e47a13 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.365747 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7951083-5c75-42de-9321-f88307e47a13 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.366493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7951083-5c75-42de-9321-f88307e47a13 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.367441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7951083-5c75-42de-9321-f88307e47a13 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.468263 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c7951083-5c75-42de-9321-f88307e47a13 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107826 May 24 10:17:05.468263 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 158/310] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:17:05 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:05.699914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:05.699914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:05.704860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.705661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.706627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:05.707485 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:05.784076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:05.792872 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e3c14755-0082-438f-a637-6ff3abca7cce tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1292 microversion: 2.1 time: 0.098342 May 24 10:17:05.793432 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 153/311] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:05 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:06.119163 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:06.119929 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:06.126191 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:06.126644 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:06.127407 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:06.128211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:06.191998 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:06.200119 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5e8a2bac-69dc-4760-a088-9f481b8254b6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1265 microversion: 2.1 time: 0.089510 May 24 10:17:06.205215 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 159/312] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:06 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:06.215836 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:06.216447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:06.222887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:06.223385 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:06.224193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:06.224682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:06.375981 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:06.384062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9d67c2e2-87ef-40cf-8a4b-042f8b266a55 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.172693 May 24 10:17:06.384621 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 154/313] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:06 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:06.708880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-c3719438-f391-4336-94d3-714ee8f999ce req-b5a62f74-0838-4efb-865f-1727352da4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1977a5eb-902f-4527-8f10-5906b15eb26b", "tag": "3fc5ecd2-f964-4265-a360-ea772ea058f1"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:06.718779 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-c3719438-f391-4336-94d3-714ee8f999ce req-b5a62f74-0838-4efb-865f-1727352da4b3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:06.719224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-c3719438-f391-4336-94d3-714ee8f999ce req-b5a62f74-0838-4efb-865f-1727352da4b3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:06.731055 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-c3719438-f391-4336-94d3-714ee8f999ce req-b5a62f74-0838-4efb-865f-1727352da4b3 service nova] Creating event network-changed:3fc5ecd2-f964-4265-a360-ea772ea058f1 for instance 1977a5eb-902f-4527-8f10-5906b15eb26b on hv-cinder-81045 May 24 10:17:06.736588 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-c3719438-f391-4336-94d3-714ee8f999ce req-b5a62f74-0838-4efb-865f-1727352da4b3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031569 May 24 10:17:06.737378 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 160/314] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:06.812034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:06.812873 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:06.825213 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:06.827300 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:06.830831 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:06.831276 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:06.969742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:06.990064 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-30a43477-5cb7-44d1-9774-7cb93a93e093 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1310 microversion: 2.1 time: 0.183032 May 24 10:17:06.996163 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 155/315] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:06 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:07.222689 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:07.224099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:07.233931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:07.234677 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:07.235609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:07.236429 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:07.404020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:07.405560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:07.415479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:07.416356 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:07.417418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:07.418913 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:07.623516 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:07.644281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e054ef9f-0521-4d80-b438-f14c75687e69 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1283 microversion: 2.1 time: 0.420881 May 24 10:17:07.644281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 161/316] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:07 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1283 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:07.799203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:07.810975 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8e3175b0-b550-4b69-b466-5d06fa033bad tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.413275 May 24 10:17:07.811562 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 156/317] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:07 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:08.009591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:08.010532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:08.016812 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:08.017484 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:08.018429 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:08.018944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:08.239897 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:08.257447 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-16067458-e2d4-4340-9415-bb952ea2e387 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.252237 May 24 10:17:08.258448 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 162/318] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:08 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:08.654678 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:08.655522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:08.663083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:08.663537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:08.664429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:08.664749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:08.798238 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:08.807957 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3b1804ee-84f0-42fb-aa9e-40289da7b4cb tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.157791 May 24 10:17:08.808707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 157/319] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:08 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:08.829503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:08.830133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:08.837156 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:08.837599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:08.838354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:08.838844 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:08.972280 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:08.988147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-967213a7-d042-41e7-b67c-514f00335aa6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1723 microversion: 2.1 time: 0.162448 May 24 10:17:08.989674 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 163/320] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:08 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:09.280547 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:09.281592 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:09.293890 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:09.296340 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:09.296811 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:09.297758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:09.298185 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:09.479740 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:09.490775 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1c30b425-cc17-4e51-b84d-0b35048574e9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.217509 May 24 10:17:09.492404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 158/321] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:09 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:09.708579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-35991ee9-643a-4d7d-8a44-265d016c0862 req-c1fbe4bc-8d1e-4679-8af9-4f51ea68b0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308bf397-c164-4d23-a78c-1a711d547789", "tag": "9380a065-ed4d-4e81-a000-d04d8fe5b231"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:09.725926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-35991ee9-643a-4d7d-8a44-265d016c0862 req-c1fbe4bc-8d1e-4679-8af9-4f51ea68b0de service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:09.726369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-35991ee9-643a-4d7d-8a44-265d016c0862 req-c1fbe4bc-8d1e-4679-8af9-4f51ea68b0de service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:09.748573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-35991ee9-643a-4d7d-8a44-265d016c0862 req-c1fbe4bc-8d1e-4679-8af9-4f51ea68b0de service nova] Creating event network-changed:9380a065-ed4d-4e81-a000-d04d8fe5b231 for instance 308bf397-c164-4d23-a78c-1a711d547789 on hv-cinder-81045 May 24 10:17:09.756521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-35991ee9-643a-4d7d-8a44-265d016c0862 req-c1fbe4bc-8d1e-4679-8af9-4f51ea68b0de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052571 May 24 10:17:09.760464 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 164/322] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:09.827328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:09.828090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:09.840307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:09.841627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:09.842497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:09.843503 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.010098 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:10.011562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:10.024259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:10.024259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.024259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:10.024503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.107784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:10.116136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ae638807-1e4c-4796-87cd-183d92c3a4c0 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.294108 May 24 10:17:10.117027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 159/323] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:09 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:10.198387 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:10.207062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8c187920-eafb-47e6-993d-bd2288b15d48 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1700 microversion: 2.1 time: 0.202929 May 24 10:17:10.207840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 165/324] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:10 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1700 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:10.225518 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3f2f150f-312c-42e5-809b-0444f958340b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:10.231990 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3f2f150f-312c-42e5-809b-0444f958340b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:10.232551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3f2f150f-312c-42e5-809b-0444f958340b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.298583 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3f2f150f-312c-42e5-809b-0444f958340b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Going to try to start instance {{(pid=118131) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 10:17:10.509391 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:10.510075 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:10.512436 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:10.517319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:10.517816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.520284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:10.520284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.550838 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3f2f150f-312c-42e5-809b-0444f958340b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action" status: 202 len: 0 microversion: 2.1 time: 0.329782 May 24 10:17:10.553523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 160/325] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:17:10 2022] POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:17:10.562369 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:10.563351 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:10.578726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:10.579467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.582780 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:10.582780 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:10.842409 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:10.850299 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:10.854218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5e7a85c8-1689-4404-b3a9-90b36338bd06 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.349452 May 24 10:17:10.860174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 166/326] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:10 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:10.875420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d6d29728-67f0-4226-b0f7-f7635809eebc tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1709 microversion: 2.1 time: 0.318019 May 24 10:17:10.876311 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 161/327] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:10 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1709 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:11.133825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:11.134494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:11.141715 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:11.142158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:11.142906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:11.143333 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:11.276046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:11.283599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6fb818a3-5e81-446e-b19e-aa3ba80b6bc9 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.155217 May 24 10:17:11.284210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 167/328] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:11 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:11.777814 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-71fdb322-eaf3-4257-afe9-8b656c761a45 req-ae156c44-208d-4fd7-a8be-35963913e899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "190646ab-9d5e-45e0-9943-0d9a204a28a2", "tag": "99738ef1-506c-46fb-964c-af0307861375"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:11.781568 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:11.789317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=18 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:11.791852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-71fdb322-eaf3-4257-afe9-8b656c761a45 req-ae156c44-208d-4fd7-a8be-35963913e899 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:11.792405 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-71fdb322-eaf3-4257-afe9-8b656c761a45 req-ae156c44-208d-4fd7-a8be-35963913e899 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:11.796482 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:11.806163 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-71fdb322-eaf3-4257-afe9-8b656c761a45 req-ae156c44-208d-4fd7-a8be-35963913e899 service nova] Creating event network-changed:99738ef1-506c-46fb-964c-af0307861375 for instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 on hv-cinder-81045 May 24 10:17:11.812183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-71fdb322-eaf3-4257-afe9-8b656c761a45 req-ae156c44-208d-4fd7-a8be-35963913e899 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037943 May 24 10:17:11.812902 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 162/329] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:11.876613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:11.877218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:11.884808 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:11.885259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:11.886033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:11.886643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:11.898628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:11.899389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:11.906707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:11.907163 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:11.907973 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:11.908591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:12.113390 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:12.122403 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9454456c-e2b9-4bdc-abe9-7d006421175c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.249826 May 24 10:17:12.122988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 168/330] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:11 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:12.138174 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:12.146344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b8572db5-20a1-4930-8e09-c0bd3b9af6a7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1709 microversion: 2.1 time: 0.253083 May 24 10:17:12.147177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 163/331] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:11 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:12.300318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:12.301059 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:12.307182 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:12.307751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:12.308672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:12.309199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:12.503498 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:12.512962 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-95b80999-f8a7-4188-ba03-adc2a645e99f tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.216477 May 24 10:17:12.522225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 169/332] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:12 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:13.145605 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:13.147392 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:13.159930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:13.160842 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:13.162719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:13.163393 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:13.164468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:13.165759 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:13.173607 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:13.174370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:13.175329 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:13.175988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:13.392273 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:13.399460 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:13.407159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b786b1a5-9968-4399-a563-c4759e104697 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.271236 May 24 10:17:13.407706 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a9e0f89f-4c9f-4547-b385-d9f3212719db tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1709 microversion: 2.1 time: 0.247828 May 24 10:17:13.408474 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 170/333] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:13 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1709 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:13.409944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 164/334] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:13 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:13.530245 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:13.530946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:13.538492 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:13.538938 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:13.539696 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:13.540161 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:13.555999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:13.672578 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:13.680797 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9c5694e0-341d-4a7f-8b50-53f3ff335c14 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.154905 May 24 10:17:13.681369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 171/335] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:13 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:14.431344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:14.431976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:14.432732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:14.433263 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:14.440912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:14.441585 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:14.441920 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:14.442373 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:14.443054 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:14.443282 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:14.443720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:14.444270 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:14.650613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:14.654795 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:14.659086 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-72544af7-ba44-423a-85ad-84faa66fe913 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1713 microversion: 2.1 time: 0.232396 May 24 10:17:14.659876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 172/336] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:14 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1713 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:14.662805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9f41d31a-5135-4535-8292-fbb2f2192ea5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.236135 May 24 10:17:14.664078 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 165/337] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:14 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:14.697590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:14.698589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:14.704208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:14.704656 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:14.705544 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:14.705976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:14.857468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:14.867409 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b71b9075-08a8-423d-b86e-6e7a4b85d34e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.172149 May 24 10:17:14.870494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 173/338] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:14 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:15.681107 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:15.681709 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:15.688186 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:15.688629 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:15.689377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:15.689802 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:15.817495 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:15.825029 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-32c95dc2-6ec0-4fdb-89bb-73d4ae8d1d68 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.148277 May 24 10:17:15.825582 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 166/339] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:15 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:15.886609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:15.887131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:15.893582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:15.894025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:15.894770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:15.895193 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:16.021647 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:16.029897 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-abc749f4-c83e-4b17-a526-5794b7b43841 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.147313 May 24 10:17:16.030463 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 174/340] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:15 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:16.732419 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-d0aa4a33-87b4-4307-b145-6224e067dcdd req-2550a386-e955-4e50-80f5-ebfafbdc567d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190646ab-9d5e-45e0-9943-0d9a204a28a2", "name": "network-vif-plugged", "status": "completed", "tag": "99738ef1-506c-46fb-964c-af0307861375"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:16.740943 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d0aa4a33-87b4-4307-b145-6224e067dcdd req-2550a386-e955-4e50-80f5-ebfafbdc567d service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:16.741382 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d0aa4a33-87b4-4307-b145-6224e067dcdd req-2550a386-e955-4e50-80f5-ebfafbdc567d service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:16.754813 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-d0aa4a33-87b4-4307-b145-6224e067dcdd req-2550a386-e955-4e50-80f5-ebfafbdc567d service nova] Creating event network-vif-plugged:99738ef1-506c-46fb-964c-af0307861375 for instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 on hv-cinder-81045 May 24 10:17:16.760787 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-d0aa4a33-87b4-4307-b145-6224e067dcdd req-2550a386-e955-4e50-80f5-ebfafbdc567d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031992 May 24 10:17:16.761373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 167/341] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:16.843762 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:16.844410 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:16.850445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:16.851105 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:16.852075 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:16.864007 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:17.027372 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:17.035489 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-53783a87-abdd-4db8-9fde-68c9969d81de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.196240 May 24 10:17:17.045298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 175/342] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:16 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:17.050611 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:17.051417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:17.058582 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:17.059172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:17.060102 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:17.060649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:17.211243 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:17.219988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-46fb61ab-f973-4988-9e31-22d0671af3d4 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.177242 May 24 10:17:17.220672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 168/343] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:17 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:18.052317 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:18.052926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:18.055718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=86 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:18.060962 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:18.061411 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:18.062224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:18.062656 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:18.197333 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:18.204846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6326dc4b-b313-4b3d-9ce8-a76503dac356 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.156530 May 24 10:17:18.205411 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 176/344] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:18 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:18.236471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:18.237509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:18.244879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:18.245239 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:18.246010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:18.246446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:18.378825 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:18.389376 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a8d39f10-98c0-4aed-a766-92d5adbc58d1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.156592 May 24 10:17:18.393413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 169/345] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:18 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:18.775649 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-a3a6b7f7-f862-49da-a0a5-089839ca55b6 req-159cf19a-1df3-4cb0-a1b1-3e8c6a3e3beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308bf397-c164-4d23-a78c-1a711d547789", "name": "network-vif-plugged", "status": "completed", "tag": "9380a065-ed4d-4e81-a000-d04d8fe5b231"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:18.784325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-a3a6b7f7-f862-49da-a0a5-089839ca55b6 req-159cf19a-1df3-4cb0-a1b1-3e8c6a3e3beb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:18.784785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-a3a6b7f7-f862-49da-a0a5-089839ca55b6 req-159cf19a-1df3-4cb0-a1b1-3e8c6a3e3beb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:18.795918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-a3a6b7f7-f862-49da-a0a5-089839ca55b6 req-159cf19a-1df3-4cb0-a1b1-3e8c6a3e3beb service nova] Creating event network-vif-plugged:9380a065-ed4d-4e81-a000-d04d8fe5b231 for instance 308bf397-c164-4d23-a78c-1a711d547789 on hv-cinder-81045 May 24 10:17:18.801094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-a3a6b7f7-f862-49da-a0a5-089839ca55b6 req-159cf19a-1df3-4cb0-a1b1-3e8c6a3e3beb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030218 May 24 10:17:18.801614 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 177/346] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:19.222250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:19.222893 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:19.229283 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:19.229736 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:19.230538 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:19.231038 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:19.363371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:19.371255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a1fe20b7-ac95-4120-8967-d8e48f82749b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.152967 May 24 10:17:19.371841 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 170/347] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:19 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:19.409096 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:19.409790 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:19.416232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:19.416681 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:19.417577 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:19.418009 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:19.551243 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:19.560812 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3117debc-d653-4b41-8b8d-6cba0e1755a1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1313 microversion: 2.1 time: 0.156174 May 24 10:17:19.561329 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 178/348] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:19 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:20.388096 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:20.390383 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:20.395262 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:20.395726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:20.396570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:20.396995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:20.531682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:20.539094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-312627d8-5431-44cc-bbb4-66ea7026eb33 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.155035 May 24 10:17:20.540190 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 171/349] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:20 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:20.577191 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:20.577790 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:20.584526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:20.584967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:20.585708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:20.586131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:20.714996 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:20.722965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b90177ad-7185-415e-8ba1-94e6b690d247 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1496 microversion: 2.1 time: 0.149594 May 24 10:17:20.723538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 179/350] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:20 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1496 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:21.557570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:21.558176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:21.564748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:21.565194 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:21.565953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:21.566387 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:21.695010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:21.705868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7b87581b-91db-4cdc-b8af-bb84fd74c105 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1366 microversion: 2.1 time: 0.149437 May 24 10:17:21.705868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 172/351] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:21 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:22.423669 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:22.424188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:22.430691 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.431140 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:22.431929 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.432363 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:22.458145 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:17:22.699204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9793a994-8123-4d10-9d97-1fb9f11ce919 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "DELETE /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 204 len: 0 microversion: 2.1 time: 0.279027 May 24 10:17:22.699719 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 180/352] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:17:22 2022] DELETE /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:17:22.708478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:22.709083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:22.715988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.716439 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:22.717212 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.717643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:22.721478 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:22.722166 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:22.728312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.728760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:22.729636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.730237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:22.910122 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:22.918040 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7845f918-e7b8-409b-9b65-fef545a8091a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1502 microversion: 2.1 time: 0.214143 May 24 10:17:22.918756 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 173/353] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:22 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:22.921419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:22.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9f10eb36-f50b-457c-8a71-93b0bd1e7696 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1556 microversion: 2.1 time: 0.212467 May 24 10:17:22.929260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 181/354] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:22 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:22.950146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07e71517-4306-4fe1-8ab7-28a410951daf tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:22.950638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-07e71517-4306-4fe1-8ab7-28a410951daf tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:22.956480 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e71517-4306-4fe1-8ab7-28a410951daf tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.957170 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e71517-4306-4fe1-8ab7-28a410951daf tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:22.957953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e71517-4306-4fe1-8ab7-28a410951daf tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:22.958388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07e71517-4306-4fe1-8ab7-28a410951daf tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:23.036709 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-07e71517-4306-4fe1-8ab7-28a410951daf tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090811 May 24 10:17:23.037370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 174/355] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:17:22 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:23.084297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1090457823", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "networks": [{"uuid": "10b937ae-23fb-4cb2-99d8-76c8cd98552f"}]}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:23.152782 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] validate_networks() for [('10b937ae-23fb-4cb2-99d8-76c8cd98552f', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:17:23.503125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:17:23.503700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:17:23.504025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:17:23.504424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:17:23.504872 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:17:23.515102 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:23.515476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:23.516294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:23.516726 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:23.534932 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Getting quotas for project 5cc2c0063a4443d2858152dd95bc074d. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:17:23.539018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Getting quotas for user aa03c345613842c5a202aa30bc05b229 and project 5cc2c0063a4443d2858152dd95bc074d. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:17:23.550152 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:17:23.553997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:17:23.669035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [a74e8761-d121-47c0-a3a9-f3c11407bded] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 10:17:23.935483 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:23.936675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:23.942652 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:23.943126 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:23.943903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:23.944332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:24.083315 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:24.090309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aec0f953-3bcf-4886-937d-bdaedd83e4b8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1502 microversion: 2.1 time: 0.159779 May 24 10:17:24.090882 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 175/356] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:23 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:24.095241 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-a4b60ec2-a41d-45cc-8a1b-a6045f34e458 req-f958017e-8df0-4ba0-9f73-11b85ce13e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308bf397-c164-4d23-a78c-1a711d547789", "tag": "9380a065-ed4d-4e81-a000-d04d8fe5b231"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:24.102978 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a4b60ec2-a41d-45cc-8a1b-a6045f34e458 req-f958017e-8df0-4ba0-9f73-11b85ce13e08 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:24.103468 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a4b60ec2-a41d-45cc-8a1b-a6045f34e458 req-f958017e-8df0-4ba0-9f73-11b85ce13e08 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:24.114677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-a4b60ec2-a41d-45cc-8a1b-a6045f34e458 req-f958017e-8df0-4ba0-9f73-11b85ce13e08 service nova] Creating event network-changed:9380a065-ed4d-4e81-a000-d04d8fe5b231 for instance 308bf397-c164-4d23-a78c-1a711d547789 on hv-cinder-81045 May 24 10:17:24.120285 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-a4b60ec2-a41d-45cc-8a1b-a6045f34e458 req-f958017e-8df0-4ba0-9f73-11b85ce13e08 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028277 May 24 10:17:24.120865 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 176/357] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:24.677557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [a74e8761-d121-47c0-a3a9-f3c11407bded] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 37250. May 24 10:17:24.682859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a78e303e-8363-40b7-9d2b-b1c94626d063 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.605289 May 24 10:17:24.689314 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 182/358] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:17:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:17:24.695207 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5bc624c1-e47c-4ca5-b352-e5ea23d264fe tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:24.696281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5bc624c1-e47c-4ca5-b352-e5ea23d264fe tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:24.767449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5bc624c1-e47c-4ca5-b352-e5ea23d264fe tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:24.776093 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5bc624c1-e47c-4ca5-b352-e5ea23d264fe tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1219 microversion: 2.1 time: 0.085244 May 24 10:17:24.791147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 177/359] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:24 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:25.107907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:25.108815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:25.115987 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:25.116433 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:25.117198 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:25.117625 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:25.280851 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:25.288528 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-42e4ac53-b38f-40eb-bbe7-329809d0085d tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1502 microversion: 2.1 time: 0.185193 May 24 10:17:25.289099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 183/360] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:25 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:25.797326 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:25.798278 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:25.811691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:25.811691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:25.811691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:25.811691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:25.882828 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:25.890570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2adf740c-354e-4468-8ebd-8870ceb99d58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1223 microversion: 2.1 time: 0.097293 May 24 10:17:25.891238 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 178/361] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:25 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:26.135231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-317f17c6-277d-4a02-8dd5-84f8a506150c req-77cf10ee-a671-41ae-a6ee-cbe5f83d35fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "190646ab-9d5e-45e0-9943-0d9a204a28a2", "name": "network-vif-deleted", "tag": "99738ef1-506c-46fb-964c-af0307861375"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:26.146525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-317f17c6-277d-4a02-8dd5-84f8a506150c req-77cf10ee-a671-41ae-a6ee-cbe5f83d35fa service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:26.147020 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-317f17c6-277d-4a02-8dd5-84f8a506150c req-77cf10ee-a671-41ae-a6ee-cbe5f83d35fa service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:26.159269 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-317f17c6-277d-4a02-8dd5-84f8a506150c req-77cf10ee-a671-41ae-a6ee-cbe5f83d35fa service nova] Creating event network-vif-deleted:99738ef1-506c-46fb-964c-af0307861375 for instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 on hv-cinder-81045 May 24 10:17:26.164327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-317f17c6-277d-4a02-8dd5-84f8a506150c req-77cf10ee-a671-41ae-a6ee-cbe5f83d35fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033789 May 24 10:17:26.164918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 184/362] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:17:26.306286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:26.307249 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:26.314027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:26.314506 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:26.315331 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:26.315825 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:26.349536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:26.349803 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:26.350395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lazy-loading 'fault' on Instance uuid 190646ab-9d5e-45e0-9943-0d9a204a28a2 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:17:26.401452 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:26.409045 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dfe2c3cc-717a-4ef6-9d4e-bf921fed233e tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 200 len: 1303 microversion: 2.1 time: 0.106771 May 24 10:17:26.409609 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 179/363] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:26 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:26.907486 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:26.908208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:26.914279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:26.914719 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:26.915470 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:26.916469 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:26.977449 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:26.985245 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ff95b00f-224e-4b90-a266-c49b4f8cf75d tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1271 microversion: 2.1 time: 0.082045 May 24 10:17:26.985797 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 185/364] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:26 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:27.427721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:27.428518 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 190646ab-9d5e-45e0-9943-0d9a204a28a2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:27.437218 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:27.437813 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:27.438698 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:27.439229 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:27.454172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] HTTP exception thrown: Instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 could not be found. May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Request method failure captured: May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 HTTP/1.1 May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLCXliz4RBwoeZRSlBUgGNuChbC2ASDCg2vBKaly-3SKZttvPCMwhZP1xqvwgO8bjgPQR43CMTDada8U1anyJS9UE3bBFk0OacSU3gCWkzVpxVshsAeJ3ZeHZ7i2nUx2ZkxT3rLszIjr9VUMen2gZ53Vd3_jUNOOXQGWIIkXhZGIWn4 May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 9a065f21900943bc8cc9b0e20e0c2438 May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesActionsTest-1837170624 May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:17:27.456515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9a065f21900943bc8cc9b0e20e0c2438"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9a065f21900943bc8cc9b0e20e0c2438"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9a065f21900943bc8cc9b0e20e0c2438", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9a065f21900943bc8cc9b0e20e0c2438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesActionsTest-1837170624 May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 9a065f21900943bc8cc9b0e20e0c2438 May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesActionsTest-1837170624 May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesActionsTest-1837170624-project May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 042d1d8fd1174df581c464239dc7f36e May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesActionsTest-1837170624-project May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 could not be found. May 24 10:17:27.458408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '190646ab-9d5e-45e0-9943-0d9a204a28a2'} May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 could not be found. May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:17:27.459244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 could not be found. May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 could not be found. May 24 10:17:27.460617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:17:27.461942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Returning 404 to user: Instance 190646ab-9d5e-45e0-9943-0d9a204a28a2 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:17:27.461942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-932b9bbb-74ca-421b-ac6a-9c5fd563de85 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2" status: 404 len: 111 microversion: 2.1 time: 0.035645 May 24 10:17:27.461942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 180/365] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:27 2022] GET /compute/v2.1/servers/190646ab-9d5e-45e0-9943-0d9a204a28a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:17:27.570126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-343529243", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "networks": [{"uuid": "fa1c8a15-069f-45cb-9d6e-331677f096dc"}]}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:27.621452 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] validate_networks() for [('fa1c8a15-069f-45cb-9d6e-331677f096dc', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:17:28.002391 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:28.003001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:28.008984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:28.009433 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:28.010925 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:28.011428 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:17:28.011555 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:28.011890 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:17:28.012367 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:17:28.012770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:17:28.013378 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:17:28.023462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:28.023919 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:28.024740 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:28.025935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:28.044435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Getting quotas for project 9a065f21900943bc8cc9b0e20e0c2438. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:17:28.049176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Getting quotas for user 042d1d8fd1174df581c464239dc7f36e and project 9a065f21900943bc8cc9b0e20e0c2438. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:17:28.063428 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:17:28.065877 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:17:28.079041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:28.086967 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1cf307ec-c4fb-43a2-8b6e-827a4c4d2c96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1277 microversion: 2.1 time: 0.088393 May 24 10:17:28.087522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 181/366] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:27 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:28.204928 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9d75f5a3-2d86-4601-b43e-eb6c02f0a6c1 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638252 May 24 10:17:28.206129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 186/367] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:17:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:17:28.222398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-80ce560b-c4ad-4d11-b938-ca53efaacb2a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:28.227471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-80ce560b-c4ad-4d11-b938-ca53efaacb2a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:28.310305 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-80ce560b-c4ad-4d11-b938-ca53efaacb2a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:28.320593 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-80ce560b-c4ad-4d11-b938-ca53efaacb2a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1213 microversion: 2.1 time: 0.102666 May 24 10:17:28.321666 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 182/368] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:28 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1213 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:29.105431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:29.106037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:29.112915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:29.113655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:29.114346 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:29.114785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:29.217858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-8422c3d1-37f1-430b-b299-900fab94cd77 req-b539f252-a5ae-4128-8679-0efe2a017f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43fcaf53-1374-45e8-a547-e1e3563558b0", "tag": "88f18573-fe67-469a-b6aa-885396a40063"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:29.238077 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8422c3d1-37f1-430b-b299-900fab94cd77 req-b539f252-a5ae-4128-8679-0efe2a017f0e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:29.238527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8422c3d1-37f1-430b-b299-900fab94cd77 req-b539f252-a5ae-4128-8679-0efe2a017f0e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:29.251178 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-8422c3d1-37f1-430b-b299-900fab94cd77 req-b539f252-a5ae-4128-8679-0efe2a017f0e service nova] Creating event network-changed:88f18573-fe67-469a-b6aa-885396a40063 for instance 43fcaf53-1374-45e8-a547-e1e3563558b0 on hv-cinder-81045 May 24 10:17:29.258676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-8422c3d1-37f1-430b-b299-900fab94cd77 req-b539f252-a5ae-4128-8679-0efe2a017f0e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042378 May 24 10:17:29.263582 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 183/369] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:17:29.286355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:29.294929 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-eda1086d-249c-49bf-b281-87106e3397eb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.194474 May 24 10:17:29.295869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 187/370] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:29 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:29.341371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:29.342072 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:29.349794 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:29.350487 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:29.354945 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:29.354945 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:29.378131 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:29.423177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:29.430800 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4d534105-6016-49f8-bf79-10bad9286560 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1217 microversion: 2.1 time: 0.094594 May 24 10:17:29.431976 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 184/371] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:29 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:30.312097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:30.312763 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:30.320697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:30.321148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:30.321919 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:30.322355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:30.449698 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:30.452542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:30.466272 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:30.466893 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:30.467979 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:30.469251 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:30.474805 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:30.494703 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2e2f5b19-cc77-4a30-a66c-ddc8d512c7e7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.185648 May 24 10:17:30.504240 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 188/372] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:30 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:30.563434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:30.570895 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7023f3ec-4d61-4b85-b569-a7e7f4759014 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1273 microversion: 2.1 time: 0.126253 May 24 10:17:30.571460 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 185/373] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:30 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:31.511697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:31.512318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:31.518812 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:31.519253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:31.520033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:31.520462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:31.524408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:31.588572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:31.589953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:31.607738 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:31.608426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:31.609399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:31.610057 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:31.694779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:31.702496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:31.703108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-91185825-dfd8-423d-9d68-f9ec5b0f8bd7 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1283 microversion: 2.1 time: 0.119058 May 24 10:17:31.703676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 186/374] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:31 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1283 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:31.710490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8ff65852-f72e-4b7a-8a5c-e0c91cbf975b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.202810 May 24 10:17:31.711043 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 189/375] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:31 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:32.721098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:32.723947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:32.727606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:32.728723 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:32.729035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:32.729580 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:32.730484 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:32.730935 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:32.735332 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:32.735775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:32.736721 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:32.737224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:32.935663 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:32.940008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:32.944367 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dbe4081d-135b-4251-be2b-15252ea32c3a tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1313 microversion: 2.1 time: 0.227089 May 24 10:17:32.945054 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 187/376] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:32 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:32.948859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-576aa334-99af-47e1-8ee1-a60b0cb11378 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.224850 May 24 10:17:32.955891 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 190/377] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:32 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:33.134395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-d134c1e0-f00b-4c2f-8a6e-6d249dbe7dda req-50bb04ba-7c9c-4772-a494-92c7e8ffd235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5df758-47f7-4751-be98-1c37c312553c", "tag": "50583011-04dd-4e7d-8a53-40bd077ea929"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:33.143867 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d134c1e0-f00b-4c2f-8a6e-6d249dbe7dda req-50bb04ba-7c9c-4772-a494-92c7e8ffd235 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:33.144543 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d134c1e0-f00b-4c2f-8a6e-6d249dbe7dda req-50bb04ba-7c9c-4772-a494-92c7e8ffd235 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:33.162359 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-d134c1e0-f00b-4c2f-8a6e-6d249dbe7dda req-50bb04ba-7c9c-4772-a494-92c7e8ffd235 service nova] Creating event network-changed:50583011-04dd-4e7d-8a53-40bd077ea929 for instance 8d5df758-47f7-4751-be98-1c37c312553c on hv-cinder-81045 May 24 10:17:33.170463 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-d134c1e0-f00b-4c2f-8a6e-6d249dbe7dda req-50bb04ba-7c9c-4772-a494-92c7e8ffd235 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040329 May 24 10:17:33.171068 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 188/378] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:33.966680 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:33.967388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:33.973235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:33.973840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:33.975432 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:33.976028 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:33.977044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:33.977684 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:33.981069 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:33.982017 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:33.982967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:33.985220 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:34.194172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:34.201015 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:34.203512 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3eae1964-cae5-4e11-a5a4-cd271ae727d2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.241425 May 24 10:17:34.204291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 189/379] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:33 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:34.210601 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ecf48878-67cb-498f-ad3a-16b55dc0c8c6 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1313 microversion: 2.1 time: 0.251659 May 24 10:17:34.211277 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 191/380] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:33 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:35.220901 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:35.221530 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:35.227830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:35.229006 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:35.229183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:35.229630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:35.230388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:35.230815 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:35.235325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:35.235767 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:35.236550 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:35.236977 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:35.425570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:35.428921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:35.434801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ee9216fb-f517-45fc-aa13-f0cbe27ee8c9 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.216233 May 24 10:17:35.434801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 190/381] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:35 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:35.437668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-31197157-3655-4308-a13a-035bd4039639 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1313 microversion: 2.1 time: 0.213498 May 24 10:17:35.438262 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 192/382] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:35 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:36.276365 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-1d56f4dd-a8c4-4d2a-bb05-7edc5ed8bb31 req-0716e177-6498-49e8-aba5-af76d599ee81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43fcaf53-1374-45e8-a547-e1e3563558b0", "name": "network-vif-plugged", "status": "completed", "tag": "88f18573-fe67-469a-b6aa-885396a40063"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:36.285099 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1d56f4dd-a8c4-4d2a-bb05-7edc5ed8bb31 req-0716e177-6498-49e8-aba5-af76d599ee81 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:36.285546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1d56f4dd-a8c4-4d2a-bb05-7edc5ed8bb31 req-0716e177-6498-49e8-aba5-af76d599ee81 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:36.296863 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-1d56f4dd-a8c4-4d2a-bb05-7edc5ed8bb31 req-0716e177-6498-49e8-aba5-af76d599ee81 service nova] Creating event network-vif-plugged:88f18573-fe67-469a-b6aa-885396a40063 for instance 43fcaf53-1374-45e8-a547-e1e3563558b0 on hv-cinder-81045 May 24 10:17:36.301675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-1d56f4dd-a8c4-4d2a-bb05-7edc5ed8bb31 req-0716e177-6498-49e8-aba5-af76d599ee81 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029128 May 24 10:17:36.302681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 191/383] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:36.450001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:36.450627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:36.454914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:36.455643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:36.457788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:36.458233 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:36.459009 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:36.459423 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:36.462563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:36.463013 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:36.465955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:36.465955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:36.866173 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:36.877294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e70f85ca-b283-412f-beff-8c644021f791 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.431267 May 24 10:17:36.878224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 193/384] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:36 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:36.887175 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:36.894771 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-580f88c3-a4cf-499b-a229-5e661b6f80aa tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1313 microversion: 2.1 time: 0.444153 May 24 10:17:36.895342 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 192/385] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:36 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:17:37.894368 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:37.894976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:37.901313 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:37.901782 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:37.902525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:37.903846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:37.910752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:37.911566 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:37.918004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:37.918540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:37.919358 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:37.919840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:38.034103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=4 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:38.060103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=12 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:38.112459 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:38.115421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:38.134353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dc35076d-064e-4688-affc-87ad075ddffc tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1313 microversion: 2.1 time: 0.217431 May 24 10:17:38.138551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 193/386] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:37 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:38.141265 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1b355452-7fc5-495f-9efb-9ceba86cc163 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1319 microversion: 2.1 time: 0.250668 May 24 10:17:38.141862 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 194/387] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:37 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:38.321353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-4c47a516-2f94-4060-8384-791922919dbd req-2fbb2221-b4dc-450a-86b3-d7c504a8ffcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5df758-47f7-4751-be98-1c37c312553c", "name": "network-vif-plugged", "status": "completed", "tag": "50583011-04dd-4e7d-8a53-40bd077ea929"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:38.325446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:38.330726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-4c47a516-2f94-4060-8384-791922919dbd req-2fbb2221-b4dc-450a-86b3-d7c504a8ffcc service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:38.331167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-4c47a516-2f94-4060-8384-791922919dbd req-2fbb2221-b4dc-450a-86b3-d7c504a8ffcc service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:38.342157 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-4c47a516-2f94-4060-8384-791922919dbd req-2fbb2221-b4dc-450a-86b3-d7c504a8ffcc service nova] Creating event network-vif-plugged:50583011-04dd-4e7d-8a53-40bd077ea929 for instance 8d5df758-47f7-4751-be98-1c37c312553c on hv-cinder-81045 May 24 10:17:38.346819 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-4c47a516-2f94-4060-8384-791922919dbd req-2fbb2221-b4dc-450a-86b3-d7c504a8ffcc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029112 May 24 10:17:38.347413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 194/388] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:39.142967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:39.143560 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:39.150858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:39.151298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:39.152082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:39.152519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:39.160498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:39.161387 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:39.170863 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:39.171310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:39.172595 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:39.173085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:39.360831 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:39.364288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:39.369018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-559d1ac7-49dc-4c2e-a11d-d43519ac1768 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1313 microversion: 2.1 time: 0.229841 May 24 10:17:39.372450 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 195/389] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:39 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:39.372867 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-79f92307-10c0-45e8-a349-a166e3eeb557 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1507 microversion: 2.1 time: 0.216808 May 24 10:17:39.373525 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 195/390] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:39 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:40.386366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:40.386958 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:40.394357 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:40.394788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:40.395559 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:40.396037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:40.531860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:40.539164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-86cd522e-98d6-4de6-838b-36aca9259468 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1313 microversion: 2.1 time: 0.156587 May 24 10:17:40.539723 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 196/391] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:40 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:41.555041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:41.555640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:41.558273 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=82 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:17:41.563944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:41.564522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:41.565528 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:41.565957 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:41.709913 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:41.718929 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-60ada52b-e5b0-4540-b4f2-ad30eafe7d63 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1497 microversion: 2.1 time: 0.167662 May 24 10:17:41.719514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 196/392] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:41 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:42.692025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:42.692592 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:42.699263 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:42.700234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:42.701319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:42.701840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:42.727476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:17:42.999860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-28adbab1-74cd-4031-b47b-9c1b09240d27 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 204 len: 0 microversion: 2.1 time: 0.311236 May 24 10:17:43.000353 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 197/393] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:17:42 2022] DELETE /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:17:43.008441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:43.009092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:43.017243 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:43.017697 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:43.018459 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:43.018891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:43.151367 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:43.159420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a78367f5-6cf9-4c0d-b30f-23afc639d208 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1503 microversion: 2.1 time: 0.154744 May 24 10:17:43.162424 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 197/394] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:43 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:44.178275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:44.179228 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:44.185116 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:44.185558 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:44.186364 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:44.186788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:44.324482 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:44.333186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-696e08c0-14ee-4696-9305-835dc496c1d8 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1503 microversion: 2.1 time: 0.159134 May 24 10:17:44.334077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 198/395] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:44 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:45.350252 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:45.350844 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:45.357338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:45.358309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:45.359061 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:45.359490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:45.494522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:45.501893 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-60a30603-bc5c-4f32-adc4-1bd1be8c7dc2 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1503 microversion: 2.1 time: 0.155409 May 24 10:17:45.502456 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 198/396] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:45 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:45.640271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-67387902-ebf2-4a30-8016-117ed3cba3c3 req-972a869b-d91b-4297-a7f8-8f494bcfd641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5df758-47f7-4751-be98-1c37c312553c", "name": "network-vif-deleted", "tag": "50583011-04dd-4e7d-8a53-40bd077ea929"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:45.648825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-67387902-ebf2-4a30-8016-117ed3cba3c3 req-972a869b-d91b-4297-a7f8-8f494bcfd641 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:45.649341 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-67387902-ebf2-4a30-8016-117ed3cba3c3 req-972a869b-d91b-4297-a7f8-8f494bcfd641 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:45.660688 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-67387902-ebf2-4a30-8016-117ed3cba3c3 req-972a869b-d91b-4297-a7f8-8f494bcfd641 service nova] Creating event network-vif-deleted:50583011-04dd-4e7d-8a53-40bd077ea929 for instance 8d5df758-47f7-4751-be98-1c37c312553c on hv-cinder-81045 May 24 10:17:45.665573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-67387902-ebf2-4a30-8016-117ed3cba3c3 req-972a869b-d91b-4297-a7f8-8f494bcfd641 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028982 May 24 10:17:45.666259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 199/397] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:17:46.519232 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:46.519869 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:46.526549 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:46.526997 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:46.527758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:46.528226 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:46.559073 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:46.559442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:46.559920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lazy-loading 'fault' on Instance uuid 8d5df758-47f7-4751-be98-1c37c312553c {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:17:46.605160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '042d1d8fd1174df581c464239dc7f36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a065f21900943bc8cc9b0e20e0c2438', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:17:46.613547 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-22db0140-abc8-4cf7-ada7-1cea1ab7a690 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 200 len: 1303 microversion: 2.1 time: 0.098208 May 24 10:17:46.614126 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 199/398] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:46 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:17:47.631658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:17:47.632280 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] [instance: 8d5df758-47f7-4751-be98-1c37c312553c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:47.638573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:47.639026 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:47.639771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:47.640230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:47.655824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] HTTP exception thrown: Instance 8d5df758-47f7-4751-be98-1c37c312553c could not be found. May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Request method failure captured: May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c HTTP/1.1 May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLCXliz4RBwoeZRSlBUgGNuChbC2ASDCg2vBKaly-3SKZttvPCMwhZP1xqvwgO8bjgPQR43CMTDada8U1anyJS9UE3bBFk0OacSU3gCWkzVpxVshsAeJ3ZeHZ7i2nUx2ZkxT3rLszIjr9VUMen2gZ53Vd3_jUNOOXQGWIIkXhZGIWn4 May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 9a065f21900943bc8cc9b0e20e0c2438 May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesActionsTest-1837170624 May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:17:47.658082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9a065f21900943bc8cc9b0e20e0c2438"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/9a065f21900943bc8cc9b0e20e0c2438"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_9a065f21900943bc8cc9b0e20e0c2438", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/9a065f21900943bc8cc9b0e20e0c2438"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesActionsTest-1837170624 May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 9a065f21900943bc8cc9b0e20e0c2438 May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesActionsTest-1837170624 May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesActionsTest-1837170624-project May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 042d1d8fd1174df581c464239dc7f36e May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesActionsTest-1837170624-project May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 8d5df758-47f7-4751-be98-1c37c312553c could not be found. May 24 10:17:47.662788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '8d5df758-47f7-4751-be98-1c37c312553c'} May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d5df758-47f7-4751-be98-1c37c312553c could not be found. May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:17:47.663501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d5df758-47f7-4751-be98-1c37c312553c could not be found. May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d5df758-47f7-4751-be98-1c37c312553c could not be found. May 24 10:17:47.664710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:17:47.665950 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] Returning 404 to user: Instance 8d5df758-47f7-4751-be98-1c37c312553c could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:17:47.665950 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-afedad26-d41a-4857-9d6a-4cb9d4d4b188 tempest-VolumesActionsTest-1837170624 tempest-VolumesActionsTest-1837170624-project] 10.222.0.44 "GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c" status: 404 len: 111 microversion: 2.1 time: 0.032720 May 24 10:17:47.665950 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 200/399] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:17:47 2022] GET /compute/v2.1/servers/8d5df758-47f7-4751-be98-1c37c312553c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:17:51.584787 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f628abb4-7bbc-4bb6-a315-2cee3595c27c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5220e8e1-ff9d-4291-bc04-e0a8453c0329"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:17:51.585854 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f628abb4-7bbc-4bb6-a315-2cee3595c27c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:17:51.592265 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f628abb4-7bbc-4bb6-a315-2cee3595c27c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:51.592715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f628abb4-7bbc-4bb6-a315-2cee3595c27c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:51.593511 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f628abb4-7bbc-4bb6-a315-2cee3595c27c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:17:51.593947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f628abb4-7bbc-4bb6-a315-2cee3595c27c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:17:52.891393 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f628abb4-7bbc-4bb6-a315-2cee3595c27c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.310320 May 24 10:17:52.902150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 200/400] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:17:51 2022] POST /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments => generated 194 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:07.550917 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e26d93e6-285f-456b-bb19-77ebafe542e2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "085b5ebb-0e54-4281-bc0c-6f5b03d88223", "device": "/dev/sdb"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:07.552497 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e26d93e6-285f-456b-bb19-77ebafe542e2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:07.555100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:07.555747 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:07.560487 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e26d93e6-285f-456b-bb19-77ebafe542e2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:07.560934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e26d93e6-285f-456b-bb19-77ebafe542e2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:07.562476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e26d93e6-285f-456b-bb19-77ebafe542e2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:07.562918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e26d93e6-285f-456b-bb19-77ebafe542e2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:13.482431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=11 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:13.483341 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:13.487686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:13.488288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:13.494808 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:13.496311 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:13.496311 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:13.496920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:13.630094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lazy-loading 'services' on Instance uuid c8b45da9-b689-4ab8-aa70-2b00c4b687f5 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:13.874497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-580e595b-a84e-40dc-8f71-1a1b2fd80f88 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-volume_attachments/fbd13b65-a6a1-4510-b552-be876933450b" status: 202 len: 0 microversion: 2.1 time: 0.393346 May 24 10:18:13.877256 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 201/401] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:18:13 2022] DELETE /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-volume_attachments/fbd13b65-a6a1-4510-b552-be876933450b => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:18:16.341545 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e26d93e6-285f-456b-bb19-77ebafe542e2 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "POST /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.794562 May 24 10:18:16.347594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 201/402] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:18:07 2022] POST /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0/os-volume_attachments => generated 194 bytes in 8797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:17.520987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:17.522058 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:17.528717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:17.529167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:17.529927 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:17.530363 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:17.552565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lazy-loading 'flavor' on Instance uuid 1977a5eb-902f-4527-8f10-5906b15eb26b {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:17.891203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c8f19c66-2b35-433d-847a-473739dbdf10 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/action" status: 200 len: 32 microversion: 2.1 time: 0.374766 May 24 10:18:17.895704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 202/403] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:18:17 2022] POST /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:18:17.899220 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:17.904276 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:17.906330 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:17.912869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:17.913324 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:17.914120 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:17.914589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:18.051904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:18.061219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a44fe01c-f38a-475c-a75f-837292a2eae5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.163387 May 24 10:18:18.062261 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 202/404] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:17 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:18.149197 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3f23cd8c-2d26-4ad6-aa6e-52c47ef5105e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:18.155392 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3f23cd8c-2d26-4ad6-aa6e-52c47ef5105e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:18.156505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3f23cd8c-2d26-4ad6-aa6e-52c47ef5105e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:18.184175 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3f23cd8c-2d26-4ad6-aa6e-52c47ef5105e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Going to try to stop instance {{(pid=118131) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 24 10:18:18.413829 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3f23cd8c-2d26-4ad6-aa6e-52c47ef5105e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action" status: 202 len: 0 microversion: 2.1 time: 0.268600 May 24 10:18:18.414955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 203/405] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:18:18 2022] POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:18:18.423671 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:18.424958 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:18.431517 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:18.431993 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:18.432961 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:18.433408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:18.676965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:18.684899 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f8bd74ea-8497-47e3-9a08-81a9533f7783 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.265289 May 24 10:18:18.685946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 203/406] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:18 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:19.026384 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc24cd08-499f-4824-a922-e5d35af47573 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:19.026991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fc24cd08-499f-4824-a922-e5d35af47573 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:19.033031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc24cd08-499f-4824-a922-e5d35af47573 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.033481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc24cd08-499f-4824-a922-e5d35af47573 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.034304 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc24cd08-499f-4824-a922-e5d35af47573 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.034745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc24cd08-499f-4824-a922-e5d35af47573 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.058862 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fc24cd08-499f-4824-a922-e5d35af47573 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789/ips" status: 200 len: 150 microversion: 2.1 time: 0.037219 May 24 10:18:19.059759 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 204/407] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:18:19 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:19.074494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f242c51-f46a-4ca7-8310-7dcd20f5cda1"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:19.076392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:19.082061 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:19.083282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:19.090972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.091287 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.091606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.091758 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.092947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.093164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.093756 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.094055 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.257568 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Invalid volume: volume 5f242c51-f46a-4ca7-8310-7dcd20f5cda1 is already attached to instances: 13731d69-8592-481c-b267-3415c90f91a1 May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: POST /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789/os-volume_attachments HTTP/1.1 May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 74 May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:18:19.259370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {"volumeAttachment": {"volumeId": "5f242c51-f46a-4ca7-8310-7dcd20f5cda1"}} May 24 10:18:19.260770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Invalid volume: volume 5f242c51-f46a-4ca7-8310-7dcd20f5cda1 is already attached to instances: 13731d69-8592-481c-b267-3415c90f91a1 May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'server_id': '308bf397-c164-4d23-a78c-1a711d547789', 'body': {'volumeAttachment': {'volumeId': '5f242c51-f46a-4ca7-8310-7dcd20f5cda1'}}} May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5f242c51-f46a-4ca7-8310-7dcd20f5cda1 is already attached to instances: 13731d69-8592-481c-b267-3415c90f91a1 May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:19.261643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5f242c51-f46a-4ca7-8310-7dcd20f5cda1 is already attached to instances: 13731d69-8592-481c-b267-3415c90f91a1 May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:19.263377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5f242c51-f46a-4ca7-8310-7dcd20f5cda1 is already attached to instances: 13731d69-8592-481c-b267-3415c90f91a1 May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 400 to user: Invalid volume: volume 5f242c51-f46a-4ca7-8310-7dcd20f5cda1 is already attached to instances: 13731d69-8592-481c-b267-3415c90f91a1 {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ffec687b-0ca0-4564-9c6a-0b9b55c361d3 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.194003 May 24 10:18:19.265816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 204/408] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:18:19 2022] POST /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789/os-volume_attachments => generated 174 bytes in 195 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 24 10:18:19.271163 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:19.271753 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:19.278853 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.279318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.280316 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.281349 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.305777 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:19.307397 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:18:19.313795 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-387b9876-b2a0-4d85-9ac3-5471ab8af4bc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.239407 May 24 10:18:19.314592 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 205/409] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:19 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:19.602384 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d7e49225-1c36-44cc-8eb3-c61d89145067 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 204 len: 0 microversion: 2.1 time: 0.334880 May 24 10:18:19.603023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 205/410] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:18:19 2022] DELETE /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:18:19.613844 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:19.614625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:19.620903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.621473 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.622486 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.623013 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.703526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:19.704247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:19.710640 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.711084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.711870 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:19.712306 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:19.821560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:19.829912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-597b3ad2-e20e-4a4f-91be-be001cd99d72 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1681 microversion: 2.1 time: 0.219995 May 24 10:18:19.830471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 206/411] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:19 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:19.865286 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:19.875787 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-18189ac0-ac8f-4b6c-9795-ffdedd996535 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.176846 May 24 10:18:19.876556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 206/412] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:19 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:20.330660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:20.331271 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:20.337911 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:20.338356 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:20.339115 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:20.339548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:20.476693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:20.484892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-61bf439a-f0ae-41c5-8c8f-50aa93672354 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.158547 May 24 10:18:20.485465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 207/413] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:20 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:20.848588 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:20.849190 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:20.856049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:20.856581 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:20.857357 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:20.857793 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:20.894123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:20.894727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:20.901074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:20.901713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:20.902671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:20.903111 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:21.045537 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:21.060430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3bcceed1-85e3-469c-91b1-1a359e1540c4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1681 microversion: 2.1 time: 0.214715 May 24 10:18:21.061884 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 207/414] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:20 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:21.078486 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:21.086503 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-654c3f12-f7d6-41b8-9a48-cb7036cdf58a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.197213 May 24 10:18:21.087151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 208/415] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:20 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:21.502511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:21.503108 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:21.508999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:21.509443 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:21.510205 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:21.510680 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:21.641221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:21.649100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-86234d18-fba4-4cf2-b6ba-e9c41595da1c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.150894 May 24 10:18:21.649810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 208/416] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:21 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:22.079450 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:22.080147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:22.086858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:22.087305 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:22.088100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:22.088540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:22.104655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:22.105524 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:22.112764 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:22.113336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:22.114366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:22.115084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:22.294007 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:22.297307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:22.302131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-033e597b-cde9-4eb7-bd77-8d3a4bc04e8c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.201548 May 24 10:18:22.302877 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 209/417] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:22 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:22.306092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-861254b8-5feb-4c54-b0c1-f93ae985264d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1681 microversion: 2.1 time: 0.231180 May 24 10:18:22.306757 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 209/418] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:22 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1681 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:22.668018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:22.668802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:22.678348 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-f9002d91-5bfe-4ef3-8709-0562c5025666 req-b0d06f55-3cdd-4cdd-b5cc-2625601fb9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308bf397-c164-4d23-a78c-1a711d547789", "name": "network-vif-deleted", "tag": "9380a065-ed4d-4e81-a000-d04d8fe5b231"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:22.686447 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:22.688199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:22.688682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f9002d91-5bfe-4ef3-8709-0562c5025666 req-b0d06f55-3cdd-4cdd-b5cc-2625601fb9a4 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:22.689270 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f9002d91-5bfe-4ef3-8709-0562c5025666 req-b0d06f55-3cdd-4cdd-b5cc-2625601fb9a4 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:22.689526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:22.690117 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:22.701788 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-f9002d91-5bfe-4ef3-8709-0562c5025666 req-b0d06f55-3cdd-4cdd-b5cc-2625601fb9a4 service nova] Creating event network-vif-deleted:9380a065-ed4d-4e81-a000-d04d8fe5b231 for instance 308bf397-c164-4d23-a78c-1a711d547789 on hv-cinder-81045 May 24 10:18:22.723242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-f9002d91-5bfe-4ef3-8709-0562c5025666 req-b0d06f55-3cdd-4cdd-b5cc-2625601fb9a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045391 May 24 10:18:22.724230 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 210/419] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:18:22.892785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:22.906129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-758184f2-aa2f-4e68-aa08-99fb3e9fa9cb tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.241598 May 24 10:18:22.907485 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 210/420] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:22 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:23.326722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:23.327546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:23.329427 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:23.330517 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:23.342624 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:23.343109 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:23.345142 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:23.346157 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:23.348103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:23.348637 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:23.352365 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:23.353222 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:23.393944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:23.394785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:23.395422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lazy-loading 'fault' on Instance uuid 308bf397-c164-4d23-a78c-1a711d547789 {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:23.472960 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:23.485322 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-537bd210-344e-4de8-9984-deb7a67ac62f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 200 len: 1330 microversion: 2.1 time: 0.165239 May 24 10:18:23.485908 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 211/421] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:23 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 1330 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:23.554805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:23.564180 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-18bfdbd6-d66d-4183-850b-fd91efa993fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.247938 May 24 10:18:23.564765 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 211/422] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:23 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:23.922720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:23.929037 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:23.932239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:23.932677 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:23.934233 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:23.935047 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:24.074392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:24.086377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1100fbee-9a98-41cc-a43d-6a1668f0b1d8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.167401 May 24 10:18:24.089320 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 212/423] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:23 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:24.503186 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:24.503886 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:24.510577 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:24.511403 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:24.512191 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:24.512618 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:24.526896 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 HTTP/1.1 May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:18:24.528612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:18:24.530066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '308bf397-c164-4d23-a78c-1a711d547789'} May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:18:24.530870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:18:24.532113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:24.533254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:18:24.533254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-609f6913-54a0-4c32-b7a7-be55aef29a42 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 404 len: 111 microversion: 2.1 time: 0.031341 May 24 10:18:24.533254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 212/424] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:24 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:18:24.539108 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bd988a15-9452-4467-8d47-ebd4c3bc3e96 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '.version_select at 0x7ff63af861f0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:24.582097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:24.582949 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:24.588913 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:24.589366 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:24.590154 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:24.590589 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:24.657440 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bd988a15-9452-4467-8d47-ebd4c3bc3e96 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628963942" status: 202 len: 0 microversion: 2.1 time: 0.121989 May 24 10:18:24.658088 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 213/425] 10.222.0.44 () {58 vars in 1217 bytes} [Tue May 24 10:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628963942 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:18:24.728951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:24.736845 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-65b88f14-ba3f-49f5-8ac4-5c656f76f976 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.159209 May 24 10:18:24.737402 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 213/426] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:24 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:24.952869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1591207685", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:25.038324 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] validate_networks() for None {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:18:25.103760 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:25.104392 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:25.112766 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.113222 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.113991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.114426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.389435 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:25.398625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-144d3e9d-0d4a-4994-9df2-0e0929343afc tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.298637 May 24 10:18:25.399306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 214/427] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:25 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:25.418937 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:18:25.419381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:18:25.419894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:18:25.420297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:18:25.420696 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:18:25.429699 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.430147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.430984 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.431414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.452114 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Getting quotas for project 87e26b35daa3412db248234ca5709b28. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:18:25.456933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Getting quotas for user 1c4272b3e96046448437bd4a4d9a66db and project 87e26b35daa3412db248234ca5709b28. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:18:25.470502 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:18:25.473073 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:18:25.604338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:25.604863 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:25.612038 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.612488 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.613253 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.613683 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.631747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:25.679621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-30f2c0d8-2a25-4d4e-ab29-168998e209ae tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730765 May 24 10:18:25.680327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 214/428] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:18:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:18:25.699472 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3051d269-25b8-4589-9038-7905b9045696 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:25.703919 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3051d269-25b8-4589-9038-7905b9045696 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:25.705065 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lazy-loading 'services' on Instance uuid 13731d69-8592-481c-b267-3415c90f91a1 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:25.768885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3051d269-25b8-4589-9038-7905b9045696 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:25.776401 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3051d269-25b8-4589-9038-7905b9045696 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1215 microversion: 2.1 time: 0.080442 May 24 10:18:25.789714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 215/429] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:25 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1215 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:25.790732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:25.791334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:25.800304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.800761 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.801544 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.801978 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.942862 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e1761b48-96a4-4c67-894d-1a182d479041 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments/5f242c51-f46a-4ca7-8310-7dcd20f5cda1" status: 202 len: 0 microversion: 2.1 time: 0.341824 May 24 10:18:25.943181 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:25.943457 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 215/430] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:18:25 2022] DELETE /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments/5f242c51-f46a-4ca7-8310-7dcd20f5cda1 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:18:25.946729 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:25.951618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2a4202b3-764a-40be-a7a5-c1bfe3f0bb93 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.164658 May 24 10:18:25.952255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 216/431] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:25 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:25.954146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2bc5d030-d6ec-4b02-8ead-3725838a673c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:25.962672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2bc5d030-d6ec-4b02-8ead-3725838a673c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:25.962672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2bc5d030-d6ec-4b02-8ead-3725838a673c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.962672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2bc5d030-d6ec-4b02-8ead-3725838a673c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.963074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2bc5d030-d6ec-4b02-8ead-3725838a673c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:25.963512 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2bc5d030-d6ec-4b02-8ead-3725838a673c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:25.994384 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2bc5d030-d6ec-4b02-8ead-3725838a673c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 May 24 10:18:25.994928 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 216/432] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:18:25 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:26.415591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:26.416251 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:26.422904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:26.423396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:26.472582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:26.472582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:26.566211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:26.574283 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a07dd288-0b66-4a65-a798-87c81e7bfa3d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.162841 May 24 10:18:26.575068 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 217/433] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:26 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:26.793160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c8f0acd5-3d8d-408a-bdcd-e2eb61ed13ed tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:26.793737 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c8f0acd5-3d8d-408a-bdcd-e2eb61ed13ed tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:26.847712 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c8f0acd5-3d8d-408a-bdcd-e2eb61ed13ed tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:26.854400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c8f0acd5-3d8d-408a-bdcd-e2eb61ed13ed tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1215 microversion: 2.1 time: 0.065097 May 24 10:18:26.854950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 217/434] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:26 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:26.978204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:26.978785 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:26.985716 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:26.986159 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:26.986933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:26.987425 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:27.005680 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-959f032a-e2a9-4986-9970-297a6a0765b6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:27.006710 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-959f032a-e2a9-4986-9970-297a6a0765b6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:27.013473 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-959f032a-e2a9-4986-9970-297a6a0765b6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:27.014017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-959f032a-e2a9-4986-9970-297a6a0765b6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:27.015340 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-959f032a-e2a9-4986-9970-297a6a0765b6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:27.015866 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-959f032a-e2a9-4986-9970-297a6a0765b6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:27.045588 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-959f032a-e2a9-4986-9970-297a6a0765b6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 May 24 10:18:27.046192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 218/435] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:18:27 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:18:27.117786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:27.126063 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fb650a16-5112-491b-aade-000e6aa093f0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.152061 May 24 10:18:27.126624 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 218/436] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:26 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:27.592204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:27.592817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:27.599404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:27.599891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:27.600657 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:27.601088 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:27.728775 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:27.737472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7ae2f1cc-8b38-47a0-ae15-0d739f775a57 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.149066 May 24 10:18:27.738030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 219/437] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:27 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:27.872174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:27.872779 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:27.880223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:27.880422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:27.881186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:27.881620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:27.941246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:27.948808 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f3052d6c-161d-412f-ad69-b17fe7eff067 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1211 microversion: 2.1 time: 0.080422 May 24 10:18:27.949354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 219/438] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:27 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:28.057401 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9f9a7590-8976-4fa1-b781-22a2c12db4d5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:28.058249 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9f9a7590-8976-4fa1-b781-22a2c12db4d5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:28.065302 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f9a7590-8976-4fa1-b781-22a2c12db4d5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.065747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f9a7590-8976-4fa1-b781-22a2c12db4d5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:28.066504 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f9a7590-8976-4fa1-b781-22a2c12db4d5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.067047 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9f9a7590-8976-4fa1-b781-22a2c12db4d5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:28.095153 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9f9a7590-8976-4fa1-b781-22a2c12db4d5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 May 24 10:18:28.095673 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 220/439] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:18:28 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:28.143789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:28.144406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:28.150305 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.150747 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:28.151496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.151969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:28.279471 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:28.287455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-39e1eca4-e281-4788-b575-68863280775d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.147591 May 24 10:18:28.288044 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 220/440] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:28 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:28.754936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:28.755547 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:28.761591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.768183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:28.768183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.768183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:28.890134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:28.898953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5c6c9e7c-5d1b-4714-bee3-ba0179180f29 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.148244 May 24 10:18:28.899530 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 221/441] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:28 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:28.965891 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:28.966492 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:28.973263 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.973706 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:28.974466 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:28.974897 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:29.037163 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:29.044441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-10e63196-485e-4948-a55e-3a1004fa5333 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1211 microversion: 2.1 time: 0.082366 May 24 10:18:29.045004 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 221/442] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:28 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:29.106417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-214f7ba9-36f0-4bba-9c45-5cb3addbce2b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:29.107340 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-214f7ba9-36f0-4bba-9c45-5cb3addbce2b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:29.113976 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214f7ba9-36f0-4bba-9c45-5cb3addbce2b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:29.114426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214f7ba9-36f0-4bba-9c45-5cb3addbce2b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:29.115183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214f7ba9-36f0-4bba-9c45-5cb3addbce2b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:29.115613 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-214f7ba9-36f0-4bba-9c45-5cb3addbce2b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:29.144757 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-214f7ba9-36f0-4bba-9c45-5cb3addbce2b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042237 May 24 10:18:29.145300 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 222/443] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:18:29 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:29.305173 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:29.305722 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:29.311830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:29.312288 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:29.313610 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:29.314044 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:29.440561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:29.448642 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-16fb1069-182d-454d-947c-1f4063018ddf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1677 microversion: 2.1 time: 0.146929 May 24 10:18:29.448798 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 222/444] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:29 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:29.917395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:29.918015 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:29.925227 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:29.925669 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:29.926421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:29.926847 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.059589 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:30.061354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:30.061967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:30.067562 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e68145bb-3cd9-42e9-91a3-4a1d6bdee64d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.154301 May 24 10:18:30.068111 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.068463 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 223/445] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:29 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:30.068591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.069312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.069746 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.133874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:30.141835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-92c0fb14-b539-457b-bf33-7c9e99614a9e tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1267 microversion: 2.1 time: 0.084817 May 24 10:18:30.143996 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 223/446] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:30 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:30.155944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4f4e2e95-42d9-48f0-9f67-9cd8d2084001 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:30.157565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4f4e2e95-42d9-48f0-9f67-9cd8d2084001 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:30.163996 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f4e2e95-42d9-48f0-9f67-9cd8d2084001 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.164458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f4e2e95-42d9-48f0-9f67-9cd8d2084001 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.165242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f4e2e95-42d9-48f0-9f67-9cd8d2084001 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.165679 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4f4e2e95-42d9-48f0-9f67-9cd8d2084001 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.194004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4f4e2e95-42d9-48f0-9f67-9cd8d2084001 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041979 May 24 10:18:30.194555 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 224/447] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:18:30 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:30.465972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:30.470056 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:30.472819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.473328 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.474107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.474545 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.610085 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:30.618025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-833627eb-5669-4613-8c3b-f35690d3b855 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1654 microversion: 2.1 time: 0.155898 May 24 10:18:30.618594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 224/448] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:30 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1654 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:30.634444 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1a597d83-ba66-40bf-8f1e-6d34eb205d4d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:30.640509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a597d83-ba66-40bf-8f1e-6d34eb205d4d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.643050 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1a597d83-ba66-40bf-8f1e-6d34eb205d4d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.664217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1a597d83-ba66-40bf-8f1e-6d34eb205d4d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Going to try to start instance {{(pid=118131) start /opt/stack/nova/nova/compute/api.py:2730}} May 24 10:18:30.842856 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1a597d83-ba66-40bf-8f1e-6d34eb205d4d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action" status: 202 len: 0 microversion: 2.1 time: 0.211380 May 24 10:18:30.844458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 225/449] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:18:30 2022] POST /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:18:30.854042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:30.854912 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:30.862050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.862597 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:30.863417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:30.863943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.011220 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:31.018876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bc650c44-435d-4be9-bafe-aa7c156b0bee tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.169462 May 24 10:18:31.025853 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 225/450] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:30 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:31.085860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:31.086548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:31.093060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.093498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.094774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.095385 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.158661 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:31.159268 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:31.172636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.173763 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.175406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.176715 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.265750 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:31.267164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:31.275446 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ab587884-50ea-4829-a9a9-e9f8184188f3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1273 microversion: 2.1 time: 0.120099 May 24 10:18:31.286751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 226/451] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:31 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:31.289640 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-569f6c8d-9947-490e-9ef1-5fde71bb1e13 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:31.290511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-569f6c8d-9947-490e-9ef1-5fde71bb1e13 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:31.294831 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d476ea64-1046-4ede-a463-aff024e5e60c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.212920 May 24 10:18:31.300427 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 226/452] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:31 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:31.303290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-569f6c8d-9947-490e-9ef1-5fde71bb1e13 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.303957 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-569f6c8d-9947-490e-9ef1-5fde71bb1e13 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.307046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-569f6c8d-9947-490e-9ef1-5fde71bb1e13 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.307046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-569f6c8d-9947-490e-9ef1-5fde71bb1e13 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.336131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-569f6c8d-9947-490e-9ef1-5fde71bb1e13 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056265 May 24 10:18:31.336683 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 227/453] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:18:31 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:18:31.397905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:31.398496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:31.405139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.405694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.407110 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.407615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.434850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:18:31.754753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bae93959-abcd-4afb-802b-35bd6f481703 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 204 len: 0 microversion: 2.1 time: 0.362336 May 24 10:18:31.755339 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 227/454] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:18:31 2022] DELETE /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:18:31.763818 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:31.764705 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:31.771298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.771745 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.772536 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:31.772967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:31.901700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:31.909370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a0e7bd84-6437-4e58-a492-99b5449014cc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1683 microversion: 2.1 time: 0.149472 May 24 10:18:31.910033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 228/455] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:31 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:32.037267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:32.037963 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:32.044297 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.044752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:32.045567 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.045997 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:32.185650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:32.193227 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-07a64ef1-7fe5-45bc-9b26-9b5d5ffdf0ff tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.160376 May 24 10:18:32.193842 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 228/456] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:32 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:32.292060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:32.292668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:32.299459 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.299941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:32.300708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.301155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:32.312474 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:32.313168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:32.319168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.319577 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:32.320424 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.320826 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:32.481771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:32.489569 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-efb9f83a-97e8-4318-901e-a7e79a84ca4f tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.201308 May 24 10:18:32.490237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 229/457] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:32 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:32.507534 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:32.510965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:32.516407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4e7ace98-791f-47d8-9b16-723601b23528 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.207181 May 24 10:18:32.516966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 229/458] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:32 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:32.926931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:32.927531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:32.933515 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.933964 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:32.934718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:32.935174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:33.059958 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:33.068135 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c5ed36ac-64cd-4bda-952e-305211f4b3fc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1683 microversion: 2.1 time: 0.144983 May 24 10:18:33.068699 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 230/459] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:32 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1683 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:33.210772 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:33.211304 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:33.218495 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:33.219206 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:33.220028 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:33.220912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:33.352490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:33.360499 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fc203dca-314f-4ed2-97b7-63fb03ecc176 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.153926 May 24 10:18:33.361031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 230/460] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:33 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:33.506386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:33.507015 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:33.513744 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:33.514194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:33.515664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:33.515664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:33.533829 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:33.534431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:33.540281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:33.540722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:33.541481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:33.541910 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:33.918777 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:33.922221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:33.926889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e4c64315-e897-4af7-b1d5-5f800a8581fd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.424265 May 24 10:18:33.927655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 231/461] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:33 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:33.931033 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9b51ea04-f2da-451f-b84d-4a5b16144dcd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.401556 May 24 10:18:33.931865 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 231/462] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:33 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:34.085175 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:34.085802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:34.091738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.092240 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.093017 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.093445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.216226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:34.224321 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0ac8685c-3ad1-4516-9dc6-fbf90460b720 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1683 microversion: 2.1 time: 0.143182 May 24 10:18:34.224875 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 232/463] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:34 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1683 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:34.377334 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:34.377940 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:34.384041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.384487 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.385252 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.385688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.513739 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:34.522019 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c1fcb9f6-dcdb-4b96-b4de-0d689aadee29 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.148659 May 24 10:18:34.522575 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 232/464] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:34 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:34.948589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:34.949123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:34.949230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:34.949328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:34.955981 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.956434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.956606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.957060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.957207 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.957853 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.958124 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:34.958567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:34.976619 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:35.143570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:35.147497 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:35.151009 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-60995b90-17ac-4469-a100-f15d14ecb46c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.206215 May 24 10:18:35.151575 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 233/465] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:34 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:35.155447 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4b70f300-a09a-4bb7-b60b-5783baddbe19 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.210729 May 24 10:18:35.160959 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 233/466] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:34 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:35.242947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:35.243478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:35.249425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:35.250536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:35.251290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:35.251723 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:35.380581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:35.388291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f6d1947a-69d9-4ec0-907c-2d62b03cb492 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1683 microversion: 2.1 time: 0.149150 May 24 10:18:35.388845 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 234/467] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:35 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:35.538709 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:35.539234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:35.541082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:35.545891 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:35.546434 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:35.547503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:35.547983 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:35.679946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:35.693284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3ef859cf-a546-461a-b933-cb60b35023e7 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.158401 May 24 10:18:35.693903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 234/468] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:35 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:36.176666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:36.177525 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:36.178354 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:36.182059 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:36.184516 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=8 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:36.193273 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.194684 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.195291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.196313 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.196775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.198457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.198903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.204112 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.541053 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:36.544186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:36.550232 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8814a2ae-bfbd-4665-a7e4-3f234d0ac739 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.385927 May 24 10:18:36.551025 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 235/469] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:36 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:36.556351 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:36.556955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:36.561930 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e8023bf9-e3a5-44af-b1da-709770eeaf0c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.392520 May 24 10:18:36.568536 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 235/470] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:36 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:36.568671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.568671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.568671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.568671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.651416 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-eb9393c5-554d-4246-9fd0-2d7198f26eb3 req-0909bc63-d3e1-45cf-8354-fa83ca4fcf56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c", "tag": "dbfd5bfd-dd59-4958-a1cc-dc24adc51ad1"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:36.667093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-eb9393c5-554d-4246-9fd0-2d7198f26eb3 req-0909bc63-d3e1-45cf-8354-fa83ca4fcf56 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.667093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-eb9393c5-554d-4246-9fd0-2d7198f26eb3 req-0909bc63-d3e1-45cf-8354-fa83ca4fcf56 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.683419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-eb9393c5-554d-4246-9fd0-2d7198f26eb3 req-0909bc63-d3e1-45cf-8354-fa83ca4fcf56 service nova] Creating event network-changed:dbfd5bfd-dd59-4958-a1cc-dc24adc51ad1 for instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c on hv-cinder-81045 May 24 10:18:36.689654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-eb9393c5-554d-4246-9fd0-2d7198f26eb3 req-0909bc63-d3e1-45cf-8354-fa83ca4fcf56 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041738 May 24 10:18:36.691135 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 236/471] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:36.711838 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:36.712218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:36.719949 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.720408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.721201 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:36.721672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:36.851587 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:36.881183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:36.888627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-39151f32-ea91-4004-b48b-adaa2a7f02fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1683 microversion: 2.1 time: 0.336225 May 24 10:18:36.889187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 236/472] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:36 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1683 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:36.995334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:37.004475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0c724b46-9911-4b0e-ae46-7a77a1b9c870 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.297363 May 24 10:18:37.005086 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 237/473] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:36 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:37.454098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-cba684d1-e816-4276-94a5-0d0bf4b0dbf9 req-e4bbd975-44c1-4a69-a152-a938414d302c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13731d69-8592-481c-b267-3415c90f91a1", "name": "network-vif-deleted", "tag": "98030c8c-9e9d-4aa3-859e-11568c7b0b1d"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:37.464395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-cba684d1-e816-4276-94a5-0d0bf4b0dbf9 req-e4bbd975-44c1-4a69-a152-a938414d302c service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:37.467978 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-cba684d1-e816-4276-94a5-0d0bf4b0dbf9 req-e4bbd975-44c1-4a69-a152-a938414d302c service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:37.476661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-cba684d1-e816-4276-94a5-0d0bf4b0dbf9 req-e4bbd975-44c1-4a69-a152-a938414d302c service nova] Creating event network-vif-deleted:98030c8c-9e9d-4aa3-859e-11568c7b0b1d for instance 13731d69-8592-481c-b267-3415c90f91a1 on hv-cinder-81045 May 24 10:18:37.481858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-cba684d1-e816-4276-94a5-0d0bf4b0dbf9 req-e4bbd975-44c1-4a69-a152-a938414d302c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032776 May 24 10:18:37.482602 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 237/474] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:37.566664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:37.568027 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:37.571737 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:37.575322 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:37.575776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:37.576585 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:37.577187 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:37.584684 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:37.586098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:37.595465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:37.596220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:37.597169 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:37.597721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:37.792624 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:37.797135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:37.801718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d215bc2a-3826-4004-8410-7517470564c3 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.238286 May 24 10:18:37.801718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 238/475] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:37 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:37.805422 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-95ada900-7cea-4feb-962a-ccb5b5fe2d99 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.225147 May 24 10:18:37.805977 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 238/476] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:37 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:37.905664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:37.906804 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:37.912952 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:37.913340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:37.914104 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:37.914538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:37.979781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:37.988517 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3099380a-7d26-4dd2-aa86-53fcc6b26799 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1615 microversion: 2.1 time: 0.086626 May 24 10:18:37.989091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 239/477] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:37 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1615 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:38.021550 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:38.022227 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:38.028320 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:38.028837 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:38.029659 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:38.030154 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:38.161337 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:38.169251 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c2bab0cb-e0c1-49fb-8eed-579b7ecfede8 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.151518 May 24 10:18:38.169853 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 239/478] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:38 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:38.817993 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:38.819188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:38.822325 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:38.822927 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:38.825893 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:38.826340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:38.827101 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:38.827533 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:38.829476 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:38.834539 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:38.834539 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:38.834539 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:39.121412 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:39.130929 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-75a30310-0d48-4497-bc15-d1ffcbc499e8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.311436 May 24 10:18:39.130929 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 240/479] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:38 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:39.134813 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:39.135405 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:39.138547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:39.146687 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:39.147231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:39.148115 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:39.148231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-08ab5ae7-882b-4add-acc3-01a57e357e4c tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.334258 May 24 10:18:39.148914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:39.158038 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 240/480] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:38 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:39.186298 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:39.186934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:39.187245 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lazy-loading 'fault' on Instance uuid 13731d69-8592-481c-b267-3415c90f91a1 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:39.188700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:39.189399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:39.196396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:39.196914 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:39.197948 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:39.198431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:39.230688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:39.239235 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c582790e-c664-464d-8bce-a418a7742094 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 200 len: 1332 microversion: 2.1 time: 0.107783 May 24 10:18:39.239904 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 241/481] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:39 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:39.331311 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:39.338976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6908b31f-0982-403b-80a4-438a5255d187 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1663 microversion: 2.1 time: 0.155232 May 24 10:18:39.343200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 241/482] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:39 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:40.148965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:40.150007 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:40.158976 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.159719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.161116 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.162050 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.165930 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:40.166716 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:40.174794 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.175666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.176740 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.177387 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.694195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:40.701625 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8974700f-5042-4223-9c14-bec06580f9d5 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.539804 May 24 10:18:40.702195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 242/483] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:40 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:40.712113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:40.715609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:40.716236 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:40.720420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-efe07415-1ae8-46d5-84c5-0f9b8a1b0897 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.576246 May 24 10:18:40.721340 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 242/484] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:40 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:40.725591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:40.726182 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:40.731602 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.731894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.732085 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.732342 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.732871 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.733091 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:40.733306 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.733521 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:40.749225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 HTTP/1.1 May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:18:40.751561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:18:40.754024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '13731d69-8592-481c-b267-3415c90f91a1'} May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:18:40.754923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:18:40.756556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:40.757850 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:18:40.757850 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ec3ef5f4-263b-4477-ae8a-ec30cf00d9e0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 404 len: 111 microversion: 2.1 time: 0.041009 May 24 10:18:40.757850 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 243/485] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:40 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:18:40.767577 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e7e100f5-2501-45ee-81a6-4a6710fc413b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '.version_select at 0x7ff63af86e50>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:40.840128 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e7e100f5-2501-45ee-81a6-4a6710fc413b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551060467" status: 202 len: 0 microversion: 2.1 time: 0.076052 May 24 10:18:40.840701 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 244/486] 10.222.0.44 () {58 vars in 1220 bytes} [Tue May 24 10:18:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551060467 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:18:40.996231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:41.004802 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-99288412-f5f7-40e6-91fb-0fc52924c975 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1667 microversion: 2.1 time: 0.282588 May 24 10:18:41.005384 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 243/487] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:40 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1667 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:41.718392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:41.719155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:41.728861 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:41.729370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:41.730177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-267373a5-ecb6-4f98-b6d3-9bbe8a692f99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: .version_select at 0x7ff63aefd550>, body: {"keypair": {"name": "tempest-keypair-149113745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnjqrBbxf3fuUgnQyrj7I8s6i9RKL06sNDhEumxCQd7W9UHP6kDGh3AGdVQbg0WDxJuOonMk9uC7dqIbzEjspaKBsASRQd77i3OO2+cOcpfVcMzAJLxBEv9haMmoGlj1Q=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:41.730666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:41.730666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:41.739624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:41.745429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-267373a5-ecb6-4f98-b6d3-9bbe8a692f99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:18:41.749281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-267373a5-ecb6-4f98-b6d3-9bbe8a692f99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:18:41.836185 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-267373a5-ecb6-4f98-b6d3-9bbe8a692f99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109692 May 24 10:18:41.836789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 244/488] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:18:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:18:41.841249 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:41.841850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:41.847912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:41.848357 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:41.849119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:41.849579 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:41.864823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:41.873014 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bf20ebaa-e5e2-4379-9ac3-1591f5cae837 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.158440 May 24 10:18:41.873616 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 245/489] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:41 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:41.982949 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:41.991698 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-51b7f29f-f42e-4e68-ba03-fadc10f89e3e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.153893 May 24 10:18:41.992379 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 245/490] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:41 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:42.890445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:42.891099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:42.898312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:42.898762 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:42.901254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:42.901254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:43.009690 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:43.010332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:43.018116 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:43.018676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:43.019466 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:43.019940 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:43.033301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:43.043959 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7a3a1a6b-49fb-4b33-a475-4d59b0563a10 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.157208 May 24 10:18:43.044954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 246/491] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:42 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:43.163960 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:43.171926 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4897eab8-a5bf-4d20-ad72-422585e19ff6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.166219 May 24 10:18:43.172494 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 246/492] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:43 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:43.450204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:43.450700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:43.458033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:43.458480 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:43.459256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:43.459690 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:43.586189 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lazy-loading 'services' on Instance uuid 43fcaf53-1374-45e8-a547-e1e3563558b0 {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:43.821276 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-60015efe-11d7-455e-a314-1448388ccc7b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "DELETE /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0/os-volume_attachments/085b5ebb-0e54-4281-bc0c-6f5b03d88223" status: 202 len: 0 microversion: 2.1 time: 0.374728 May 24 10:18:43.821971 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 247/493] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:18:43 2022] DELETE /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0/os-volume_attachments/085b5ebb-0e54-4281-bc0c-6f5b03d88223 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:18:44.030695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-325797106", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b9088f5-9d8c-4699-894a-607b83cfa3db"}], "security_groups": [{"name": "tempest-securitygroup--106096527"}], "key_name": "tempest-keypair-149113745", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:44.063045 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:44.064555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:44.074275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:44.074722 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:44.075480 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:44.075935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:44.163846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] validate_networks() for [('4b9088f5-9d8c-4699-894a-607b83cfa3db', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:18:44.284641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:44.292001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f50bfbce-2bd0-411d-9aa7-8a0534da1704 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.233580 May 24 10:18:44.292599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 248/494] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:44 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:44.296969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:44.297570 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:44.304094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:44.304534 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:44.305334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:44.305770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:44.524047 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:44.532207 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-978bfe41-9ef5-43bb-b40c-2ebfab4a4967 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.238528 May 24 10:18:44.532773 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 249/495] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:44 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:44.633168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:18:44.633585 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:18:44.643490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:18:44.643490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:18:44.643490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:18:44.645540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:44.646044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:44.647387 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:44.647846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:44.666223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:18:44.671021 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:18:44.683134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:18:44.685448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:18:44.791025 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dca2ad10-b979-4980-b260-ed62e1bbd976 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.764559 May 24 10:18:44.796634 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 247/496] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:18:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:18:44.804040 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-20ef779a-6221-45c7-92ea-362c57890570 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:44.804644 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-20ef779a-6221-45c7-92ea-362c57890570 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:44.865288 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-20ef779a-6221-45c7-92ea-362c57890570 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:44.876476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-20ef779a-6221-45c7-92ea-362c57890570 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1240 microversion: 2.1 time: 0.078118 May 24 10:18:44.877222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 250/497] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:44 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1240 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:44.991908 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-b0f118ed-4ca5-4427-805b-06176dec28ba req-ec02cbd1-ec91-44fe-afc8-8a35d26ed6eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c", "name": "network-vif-plugged", "status": "completed", "tag": "dbfd5bfd-dd59-4958-a1cc-dc24adc51ad1"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:45.001739 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b0f118ed-4ca5-4427-805b-06176dec28ba req-ec02cbd1-ec91-44fe-afc8-8a35d26ed6eb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:45.002187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b0f118ed-4ca5-4427-805b-06176dec28ba req-ec02cbd1-ec91-44fe-afc8-8a35d26ed6eb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:45.012643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-b0f118ed-4ca5-4427-805b-06176dec28ba req-ec02cbd1-ec91-44fe-afc8-8a35d26ed6eb service nova] Creating event network-vif-plugged:dbfd5bfd-dd59-4958-a1cc-dc24adc51ad1 for instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c on hv-cinder-81045 May 24 10:18:45.017758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-b0f118ed-4ca5-4427-805b-06176dec28ba req-ec02cbd1-ec91-44fe-afc8-8a35d26ed6eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029538 May 24 10:18:45.018337 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 248/498] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:45.309153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:45.309762 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:45.317735 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:45.318184 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:45.319009 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:45.319388 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:45.446972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:45.454476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c5d1bf62-2448-4892-aa2c-daa1bf42fdc7 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.149123 May 24 10:18:45.455086 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 251/499] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:45 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:45.550167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:45.550853 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:45.556956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:45.557401 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:45.558216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:45.558654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:45.562608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:45.685224 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:45.693132 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-19073e59-a582-4399-9d04-b6f2c2dfd7f0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.148488 May 24 10:18:45.693692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 249/500] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:45 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:45.894041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:45.894920 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:45.900998 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:45.901449 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:45.902204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:45.902637 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:45.966092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:45.969577 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:45.974325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4b6e349f-5116-4c43-9396-26180cd457b4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1244 microversion: 2.1 time: 0.084720 May 24 10:18:45.974885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 252/501] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:45 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:46.003152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:46.003631 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:46.009517 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.009959 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.010708 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.012525 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.035379 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:18:46.335674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a5ed2a27-4ece-44c5-9b2c-2272927d23aa tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "DELETE /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 204 len: 0 microversion: 2.1 time: 0.336236 May 24 10:18:46.336327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 250/502] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:18:45 2022] DELETE /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 10:18:46.345287 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:46.345935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:46.352738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.353186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.353934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.354364 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.473183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:46.473884 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:46.480037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.480490 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.481264 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.481697 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.484897 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:46.492864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e5d5af55-75fa-4033-a4c8-3bf1bd91eb58 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1513 microversion: 2.1 time: 0.152186 May 24 10:18:46.493439 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 253/503] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:46 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:46.620173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:46.627747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-34995449-4e82-4a45-9b12-a93266d87225 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.159598 May 24 10:18:46.628332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 251/504] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:46 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:46.710036 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:46.710637 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:46.716740 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.717196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.717957 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.718393 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.844444 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:46.856270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f00269e2-fc71-482a-8051-b8e0ed016243 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.150272 May 24 10:18:46.856845 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 254/505] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:46 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:46.990719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:46.991317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:46.997260 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.997703 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:46.998451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:46.998877 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:47.058161 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:47.065862 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0f97dfe5-bae6-4f64-9024-fbcf79807e90 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1236 microversion: 2.1 time: 0.078904 May 24 10:18:47.066417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 252/506] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:46 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:47.509926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:47.510517 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:47.517020 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:47.517461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:47.518214 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:47.518639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:47.644831 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:47.645377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:47.647153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:47.651771 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:47.652242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:47.652999 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:47.653428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:47.654684 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2e145e7e-2d94-4823-8756-843e9a4f2392 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1513 microversion: 2.1 time: 0.148639 May 24 10:18:47.655248 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 255/507] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:47 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:47.777440 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:47.785348 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-186c6759-9f89-4b93-a829-567167353689 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.144665 May 24 10:18:47.785901 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 253/508] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:47 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:47.873250 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:47.873846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:47.880008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:47.880458 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:47.881252 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:47.881685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:48.011125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:48.019690 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7163b399-43f8-48cd-bb85-4bd10dfd5c0d tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.150325 May 24 10:18:48.020292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 256/509] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:47 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:48.082485 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:48.083366 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:48.089284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:48.089726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:48.090476 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:48.090903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:48.151255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:48.158923 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5311aea3-e14d-4ab1-8ed1-c0e3f76d051e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1236 microversion: 2.1 time: 0.080385 May 24 10:18:48.159604 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 254/510] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:48 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:48.672246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:48.673407 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:48.680032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:48.680486 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:48.681256 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:48.681816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:48.801522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:48.802134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:48.808643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:48.809097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:48.809866 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:48.810301 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:48.813953 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:48.825493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2dbd364a-3a4d-421e-aaac-6b76d16436fb tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1513 microversion: 2.1 time: 0.156939 May 24 10:18:48.826443 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 257/511] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:48 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:48.962712 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:48.970665 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8162e152-e443-420a-8ad3-cdd045196bb9 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1315 microversion: 2.1 time: 0.172523 May 24 10:18:48.971240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 255/512] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:48 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:49.037408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:49.038054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:49.044032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.044478 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:49.045232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.045664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:49.174579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:49.175558 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:49.176206 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:49.182166 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.182627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:49.183089 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5ca3cb37-0a41-45af-95bb-180cc56634be tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.149454 May 24 10:18:49.183436 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.183658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 258/513] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:49 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:49.183857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:49.245527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:49.253958 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fe4a5917-c61a-4f94-a171-5b8dc0ba461e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1292 microversion: 2.1 time: 0.082404 May 24 10:18:49.254519 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 256/514] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:49 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:49.851976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:49.852652 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:49.859285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.859736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:49.861308 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.861859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:49.988459 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:49.989072 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:49.995499 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.996044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:49.996811 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:49.997237 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.001226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:50.009664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4d8592cb-b186-4f18-9282-4e0d0756b399 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1513 microversion: 2.1 time: 0.161529 May 24 10:18:50.010694 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 259/515] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:49 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:50.132445 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:50.139915 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6441c463-4735-48e1-9cc4-32eae75c3989 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1464 microversion: 2.1 time: 0.156056 May 24 10:18:50.140484 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 257/516] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:49 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:50.191345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:50.192425 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:50.201639 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:50.202300 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:50.204720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.204720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.205393 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.206259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.215962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.216550 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.217385 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.217822 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.249119 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:18:50.458606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:50.467578 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3b205da7-2b94-48ae-a74b-e8320edab16c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1734 microversion: 2.1 time: 0.270329 May 24 10:18:50.478475 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 258/517] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:50 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1734 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:50.478475 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:50.478475 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:50.480815 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.481383 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.482315 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.482804 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.552726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:50.560050 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-261e46bc-6652-4d56-9d2c-51900c5f00b9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1300 microversion: 2.1 time: 0.090852 May 24 10:18:50.560756 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 259/518] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:50 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:50.588876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-476f1854-412d-4f67-8d35-086aa38300ba tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 204 len: 0 microversion: 2.1 time: 0.402320 May 24 10:18:50.589483 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 260/519] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:18:50 2022] DELETE /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:18:50.598425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:50.599094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:50.605249 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.605701 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.606470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.606905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.790378 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-e7c51e2a-44b5-4341-a63a-5d5f15d68293 req-495353c9-6b3f-4754-a7cf-70b0cf152ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43fcaf53-1374-45e8-a547-e1e3563558b0", "name": "network-vif-deleted", "tag": "88f18573-fe67-469a-b6aa-885396a40063"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:50.805574 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-e7c51e2a-44b5-4341-a63a-5d5f15d68293 req-495353c9-6b3f-4754-a7cf-70b0cf152ca9 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:50.806418 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-e7c51e2a-44b5-4341-a63a-5d5f15d68293 req-495353c9-6b3f-4754-a7cf-70b0cf152ca9 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:50.814414 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:50.820414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-e7c51e2a-44b5-4341-a63a-5d5f15d68293 req-495353c9-6b3f-4754-a7cf-70b0cf152ca9 service nova] Creating event network-vif-deleted:88f18573-fe67-469a-b6aa-885396a40063 for instance 43fcaf53-1374-45e8-a547-e1e3563558b0 on hv-cinder-81045 May 24 10:18:50.822093 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-01753afe-cc87-466a-b07d-c185ed708cad tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1470 microversion: 2.1 time: 0.228325 May 24 10:18:50.822856 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 260/520] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:50 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:50.835100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-e7c51e2a-44b5-4341-a63a-5d5f15d68293 req-495353c9-6b3f-4754-a7cf-70b0cf152ca9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048529 May 24 10:18:50.835678 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 261/521] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:18:51.028210 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:51.028965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:51.035587 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.036074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.036846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.037280 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.100993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:51.108713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7dc5b547-b08a-4048-be29-45bbb9064c1a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1304 microversion: 2.1 time: 0.084422 May 24 10:18:51.109269 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 261/522] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:51 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:51.487639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:51.488336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:51.494561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.495000 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.495751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.496208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.578009 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:51.578615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:51.584971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.585419 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.586190 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.586623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.633240 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:51.641577 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3fe6d601-48b5-4eb8-bfe9-bf7c3197ecf8 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1714 microversion: 2.1 time: 0.159437 May 24 10:18:51.646211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 262/523] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:51 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:51.648893 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:51.656425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2124608e-0652-4d76-96da-2c738add6a45 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1310 microversion: 2.1 time: 0.082271 May 24 10:18:51.657794 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 262/524] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:51 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:51.742417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:51.742911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:51.748976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.749431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.750199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.750637 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.838493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] HTTP exception thrown: Cannot 'detach_volume' instance 1977a5eb-902f-4527-8f10-5906b15eb26b while it is in vm_state rescued May 24 10:18:51.840008 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Request method failure captured: May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments/5220e8e1-ff9d-4291-bc04-e0a8453c0329 HTTP/1.1 May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_8tQi6wMxPCTc3pS2gwEbfG2aOiCJ01U6sf1SmGdU5szWloH5BU1k2nT4FISfY1tg_KZcBZ0N60ytyG7xNeF2_bRfGTo3syuKWH61tulbcqp789BMMnsv5DCeYdFwqr_1IIiLi6gklaukfv7nSQYCZPTJxZ7HAFVrC-cdLyhFTw7w May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:18:51.840139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_544ebc06855b4435b767c0cc885ec068", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 04058cb7cf374eba92fb7ee796084e20 May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:18:51.841648 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Cannot 'detach_volume' instance 1977a5eb-902f-4527-8f10-5906b15eb26b while it is in vm_state rescued May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'server_id': '1977a5eb-902f-4527-8f10-5906b15eb26b', 'id': '5220e8e1-ff9d-4291-bc04-e0a8453c0329'} May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1977a5eb-902f-4527-8f10-5906b15eb26b in vm_state rescued. Cannot detach_volume while the instance is in this state. May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:18:51.842381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1977a5eb-902f-4527-8f10-5906b15eb26b while it is in vm_state rescued May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1977a5eb-902f-4527-8f10-5906b15eb26b while it is in vm_state rescued May 24 10:18:51.843562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:51.845258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:51.845461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Returning 409 to user: Cannot 'detach_volume' instance 1977a5eb-902f-4527-8f10-5906b15eb26b while it is in vm_state rescued {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:18:51.845461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-03c09858-2629-4b16-b0a0-cd1c67a2563a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments/5220e8e1-ff9d-4291-bc04-e0a8453c0329" status: 409 len: 152 microversion: 2.1 time: 0.103106 May 24 10:18:51.845461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 263/525] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:18:51 2022] DELETE /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments/5220e8e1-ff9d-4291-bc04-e0a8453c0329 => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 24 10:18:51.850721 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-065b9a46-0485-4a06-bd99-dba03980e300 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:51.850893 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.851242 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-065b9a46-0485-4a06-bd99-dba03980e300 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:51.851344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.852029 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.852458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.857174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-065b9a46-0485-4a06-bd99-dba03980e300 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.857623 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-065b9a46-0485-4a06-bd99-dba03980e300 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.858382 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-065b9a46-0485-4a06-bd99-dba03980e300 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:51.858816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-065b9a46-0485-4a06-bd99-dba03980e300 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:51.984575 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:51.992149 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2ab39016-8623-443b-9253-756458fa83bf tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1470 microversion: 2.1 time: 0.155967 May 24 10:18:51.992713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 263/526] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:51 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:52.070205 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-065b9a46-0485-4a06-bd99-dba03980e300 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "POST /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/action" status: 202 len: 0 microversion: 2.1 time: 0.222960 May 24 10:18:52.070987 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 264/527] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:18:51 2022] POST /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:18:52.079724 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:52.080454 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:52.087127 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:52.087580 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:52.088377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:52.088812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:52.092949 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:52.126311 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:52.127557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:52.136809 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:52.137413 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:52.138363 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:52.139029 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:52.227125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:52.234549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9603e52a-ab52-48c6-9c1e-2ecdbc79e800 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 200 len: 1304 microversion: 2.1 time: 0.113061 May 24 10:18:52.235190 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 265/528] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:52 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:52.255782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:52.263425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cb11b802-a82e-490f-88c1-60b67081c020 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1722 microversion: 2.1 time: 0.188254 May 24 10:18:52.264066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 264/529] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:52 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:52.673454 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:52.674158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:52.680591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:52.681041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:52.681800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:52.682231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:52.773650 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:52.781487 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9581ff07-a6fa-4a17-9107-cf9207a39a43 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1298 microversion: 2.1 time: 0.111872 May 24 10:18:52.782097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 266/530] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:52 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:53.009602 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:53.010638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:53.020736 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.020736 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.020736 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.020736 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.251664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:53.253478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:53.253948 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 43fcaf53-1374-45e8-a547-e1e3563558b0] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:53.261227 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-82d6accb-2933-438c-b937-e0b085d46729 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1470 microversion: 2.1 time: 0.255512 May 24 10:18:53.261496 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.261889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.262362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 265/531] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:53 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1470 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:53.262748 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.263127 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.278034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] HTTP exception thrown: Instance 43fcaf53-1374-45e8-a547-e1e3563558b0 could not be found. May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Request method failure captured: May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 HTTP/1.1 May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLCwAwL-KqDZKJXLc0KB6wE1n7KkT4ho3VMIpANLwRjtfg5TwFC2azcMzNxAp3slQ1yRQFv1iQWlkjf8_hlyRAmLhHaLtDfjfKo2mgg7cTRPJFd3mCOhfS6yaaXbZhlq4CSDP2PCbKSM2XgAUKyhAGTbtzQ8f_noXnA6k-YO0xC0wDQ May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 5cc2c0063a4443d2858152dd95bc074d May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1881091484 May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:18:53.279835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5cc2c0063a4443d2858152dd95bc074d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5cc2c0063a4443d2858152dd95bc074d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5cc2c0063a4443d2858152dd95bc074d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5cc2c0063a4443d2858152dd95bc074d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesSnapshotTestJSON-1881091484 May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 5cc2c0063a4443d2858152dd95bc074d May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1881091484 May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesSnapshotTestJSON-1881091484-project May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: aa03c345613842c5a202aa30bc05b229 May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesSnapshotTestJSON-1881091484-project May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 43fcaf53-1374-45e8-a547-e1e3563558b0 could not be found. May 24 10:18:53.281356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '43fcaf53-1374-45e8-a547-e1e3563558b0'} May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43fcaf53-1374-45e8-a547-e1e3563558b0 could not be found. May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:18:53.282900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43fcaf53-1374-45e8-a547-e1e3563558b0 could not be found. May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43fcaf53-1374-45e8-a547-e1e3563558b0 could not be found. May 24 10:18:53.285195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:18:53.286548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Returning 404 to user: Instance 43fcaf53-1374-45e8-a547-e1e3563558b0 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:18:53.286548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-51e5a7e1-a774-4295-810c-4c69e5a18810 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0" status: 404 len: 111 microversion: 2.1 time: 0.034203 May 24 10:18:53.286548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 267/532] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:53 2022] GET /compute/v2.1/servers/43fcaf53-1374-45e8-a547-e1e3563558b0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:18:53.287125 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:53.287559 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:53.306120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.307734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.312857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.312857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.492170 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:53.501813 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-707804f4-f7f2-4f50-8805-18e6858a4be4 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1722 microversion: 2.1 time: 0.223794 May 24 10:18:53.502545 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 266/533] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:53 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:53.557793 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-16225578-e891-4baa-8315-753480fd9242 req-222b0ee3-0012-41e4-a6ce-c1ae0dbb40a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c", "name": "network-vif-deleted", "tag": "dbfd5bfd-dd59-4958-a1cc-dc24adc51ad1"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:53.569610 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-16225578-e891-4baa-8315-753480fd9242 req-222b0ee3-0012-41e4-a6ce-c1ae0dbb40a0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.570789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-16225578-e891-4baa-8315-753480fd9242 req-222b0ee3-0012-41e4-a6ce-c1ae0dbb40a0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.577048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:53.595125 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-16225578-e891-4baa-8315-753480fd9242 req-222b0ee3-0012-41e4-a6ce-c1ae0dbb40a0 service nova] Creating event network-vif-deleted:dbfd5bfd-dd59-4958-a1cc-dc24adc51ad1 for instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c on hv-cinder-81045 May 24 10:18:53.600662 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-16225578-e891-4baa-8315-753480fd9242 req-222b0ee3-0012-41e4-a6ce-c1ae0dbb40a0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047232 May 24 10:18:53.602355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 268/534] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:18:53.802741 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:53.804234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:53.846004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.849030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.849784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:53.850340 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:53.994076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:54.002827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5b641a9f-5bab-466d-a4ec-aa652e04e4b7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.207158 May 24 10:18:54.003411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 267/535] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:53 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:54.279467 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:54.280199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:54.287289 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:54.287729 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:54.288549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:54.288978 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:54.319848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:54.320293 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:54.320727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lazy-loading 'fault' on Instance uuid 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:54.363903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:54.371476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-23e1d121-b17d-4c6e-975f-ba02f770cfdd tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1305 microversion: 2.1 time: 0.096454 May 24 10:18:54.372174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 269/536] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:54 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:54.519164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:54.520394 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:54.527240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:54.527697 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:54.528514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:54.528949 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:54.655311 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:54.655934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-45f05b5b-72df-4e77-b8f9-d24c4a8d7dc3 req-8009b005-d2c6-410b-b0fd-b8d01510f831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a59bc4-faf8-4394-9fc6-fd0acdf1215a", "tag": "91a43870-9dca-42b2-a5c1-b943d1673abb"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:18:54.667167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:54.675389 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-45f05b5b-72df-4e77-b8f9-d24c4a8d7dc3 req-8009b005-d2c6-410b-b0fd-b8d01510f831 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:54.675826 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-45f05b5b-72df-4e77-b8f9-d24c4a8d7dc3 req-8009b005-d2c6-410b-b0fd-b8d01510f831 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:54.680216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=10 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:54.683449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-199eaec0-a0e1-4af3-bdc1-6fae4fed3818 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1722 microversion: 2.1 time: 0.168437 May 24 10:18:54.684209 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 268/537] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:54 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:54.693303 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-45f05b5b-72df-4e77-b8f9-d24c4a8d7dc3 req-8009b005-d2c6-410b-b0fd-b8d01510f831 service nova] Creating event network-changed:91a43870-9dca-42b2-a5c1-b943d1673abb for instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a on hv-cinder-81045 May 24 10:18:54.698794 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-45f05b5b-72df-4e77-b8f9-d24c4a8d7dc3 req-8009b005-d2c6-410b-b0fd-b8d01510f831 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051071 May 24 10:18:54.699385 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 270/538] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:55.019656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:55.020215 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:55.026525 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:55.026966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:55.027715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:55.028169 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:55.154951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:55.162326 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cc3bcdcf-1993-4416-8577-408adb4b4bd6 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.147832 May 24 10:18:55.162886 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 269/539] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:55 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:55.389303 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:55.389995 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:55.392533 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:18:55.398017 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:55.398461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:55.399222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:55.399655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:55.431162 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:55.431637 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:55.432105 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lazy-loading 'fault' on Instance uuid 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:55.477924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:55.485951 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-70b54690-2860-4af4-a572-50f60abf8320 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1305 microversion: 2.1 time: 0.100197 May 24 10:18:55.486514 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 271/540] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:55 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:55.701560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:55.702196 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:55.709291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:55.709978 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:55.710596 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:55.711036 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:55.836837 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:55.845457 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-929973a6-25ae-4f1e-b28f-f0f483ef0e34 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1722 microversion: 2.1 time: 0.147080 May 24 10:18:55.846075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 270/541] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:55 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:56.178991 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:56.179510 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:56.185546 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:56.185990 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:56.186754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:56.187185 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:56.312225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:56.320034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8d71e2a4-d633-44fd-b84a-5ba98e3aa3a7 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.144902 May 24 10:18:56.320590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 272/542] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:56 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:56.503021 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:56.503633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:56.509692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:56.510139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:56.510896 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:56.511353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:56.540603 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:56.541045 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:56.541488 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lazy-loading 'fault' on Instance uuid 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:56.584559 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:56.591728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-efbec095-e308-4220-8d3a-50b984d1b662 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1305 microversion: 2.1 time: 0.093281 May 24 10:18:56.592310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 271/543] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:56 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:56.863112 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:56.863710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:56.870236 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:56.870686 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:56.871444 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:56.871900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:57.000074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:57.008095 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-200a57c2-e64f-4bf7-a762-8299b3308b0a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1722 microversion: 2.1 time: 0.149454 May 24 10:18:57.008871 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 273/544] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:56 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:57.338106 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:57.338824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:57.345817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:57.346259 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:57.347016 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:57.347443 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:57.478146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:57.485954 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4b77fa1a-2072-4ef5-b8a9-403f280250a8 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.151635 May 24 10:18:57.486525 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 272/545] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:57 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:57.608931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:57.610802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:57.616435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:57.616982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:57.617816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:57.618313 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:57.649997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:57.650433 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:57.650873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lazy-loading 'fault' on Instance uuid 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:18:57.696573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4272b3e96046448437bd4a4d9a66db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e26b35daa3412db248234ca5709b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:57.704756 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c6d79d89-93f2-4d7b-be25-fa5fdc59f156 tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 200 len: 1305 microversion: 2.1 time: 0.099199 May 24 10:18:57.708219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 274/546] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:57 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:58.025481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:58.026083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:58.032557 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:58.046121 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:58.046121 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:58.046121 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:58.168662 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:58.176791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3fcdf772-2394-4ed2-82e0-9b2854be1ca5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1722 microversion: 2.1 time: 0.155036 May 24 10:18:58.177368 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 273/547] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:58 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:58.502633 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:58.503231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:58.509316 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:58.509761 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:58.510518 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:58.510944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:58.644765 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:58.652838 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-75448d8b-288a-4632-8d69-c51cdecf44de tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.154067 May 24 10:18:58.653559 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 275/548] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:58 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:18:58.723701 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:58.724325 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] [instance: 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:58.737007 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:58.737609 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:58.738415 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:58.738857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:58.753671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] HTTP exception thrown: Instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c could not be found. May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Request method failure captured: May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c HTTP/1.1 May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLDvVOUtLWeR40GZJTy700rhjgT7usFS496BqeoBJz7j5IIBbUN699ffrNXRBHrBlKKTpo7q-0-UCNmDXz-7VGhY6zusRuAMR6SQ2K4Dqqco-m_5CK0kr1RiJzLOnO2c_PbJH4Fpkje3P9ZENRgSRpYJq-3GdLTx7cMWjSXZvQ7ID-w May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 87e26b35daa3412db248234ca5709b28 May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesNegativeTest-1171299873 May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:18:58.755397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/87e26b35daa3412db248234ca5709b28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/87e26b35daa3412db248234ca5709b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_87e26b35daa3412db248234ca5709b28", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/87e26b35daa3412db248234ca5709b28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesNegativeTest-1171299873 May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 87e26b35daa3412db248234ca5709b28 May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesNegativeTest-1171299873 May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesNegativeTest-1171299873-project May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 1c4272b3e96046448437bd4a4d9a66db May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesNegativeTest-1171299873-project May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c could not be found. May 24 10:18:58.761968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c'} May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c could not be found. May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:18:58.762806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c could not be found. May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c could not be found. May 24 10:18:58.764413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:18:58.765597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] Returning 404 to user: Instance 0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:18:58.765597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bbabdd8c-1025-403a-9a6e-4dd7310f22aa tempest-VolumesNegativeTest-1171299873 tempest-VolumesNegativeTest-1171299873-project] 10.222.0.44 "GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c" status: 404 len: 111 microversion: 2.1 time: 0.038298 May 24 10:18:58.765597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 274/549] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:58 2022] GET /compute/v2.1/servers/0ebbfe4b-d04a-46d0-b9c5-da5974d6c85c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:18:59.195043 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:59.195666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:59.201862 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:59.202883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:59.203979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:59.204591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:59.340932 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:59.348793 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d2c5f245-ae7a-4dad-8b1b-af986549f461 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1728 microversion: 2.1 time: 0.157977 May 24 10:18:59.349347 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 276/550] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:59 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:18:59.365849 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8c404b52-5d68-4bec-863a-51598d4202bf tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:59.366337 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8c404b52-5d68-4bec-863a-51598d4202bf tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:59.372901 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c404b52-5d68-4bec-863a-51598d4202bf tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:59.373381 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c404b52-5d68-4bec-863a-51598d4202bf tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:59.374144 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c404b52-5d68-4bec-863a-51598d4202bf tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:59.374576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8c404b52-5d68-4bec-863a-51598d4202bf tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:59.454616 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8c404b52-5d68-4bec-863a-51598d4202bf tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092688 May 24 10:18:59.455246 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 275/551] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:18:59 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:18:59.669168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:18:59.673548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:18:59.679522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:59.679995 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:59.680766 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:18:59.681196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:18:59.925635 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:18:59.933442 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f46566df-719b-46d0-bd46-f881a2854d99 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.267968 May 24 10:18:59.934492 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 277/552] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:18:59 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:00.722875 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-e3ddf161-543c-40f6-b463-3d00a9d49411 req-d0058277-daeb-41b0-b8a2-574a2e274eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1977a5eb-902f-4527-8f10-5906b15eb26b", "tag": "3fc5ecd2-f964-4265-a360-ea772ea058f1"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:00.731657 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e3ddf161-543c-40f6-b463-3d00a9d49411 req-d0058277-daeb-41b0-b8a2-574a2e274eab service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:00.732456 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-e3ddf161-543c-40f6-b463-3d00a9d49411 req-d0058277-daeb-41b0-b8a2-574a2e274eab service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:00.747270 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-e3ddf161-543c-40f6-b463-3d00a9d49411 req-d0058277-daeb-41b0-b8a2-574a2e274eab service nova] Creating event network-changed:3fc5ecd2-f964-4265-a360-ea772ea058f1 for instance 1977a5eb-902f-4527-8f10-5906b15eb26b on hv-cinder-81045 May 24 10:19:00.752646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-e3ddf161-543c-40f6-b463-3d00a9d49411 req-d0058277-daeb-41b0-b8a2-574a2e274eab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034464 May 24 10:19:00.753234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 276/553] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:00.950447 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:00.953489 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:00.959213 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:00.959672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:00.960478 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:00.960917 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:01.096673 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:01.104424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5a4a742e-36e6-4aaa-9203-dee2c08edba1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.157851 May 24 10:19:01.114164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 278/554] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:00 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:02.122661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:02.123362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:02.129646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:02.130122 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:02.130885 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:02.131319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:02.275770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:02.283717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4d471dfa-7737-4e79-9254-0c8e71d08023 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.166255 May 24 10:19:02.284314 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 277/555] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:02 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:02.767812 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-691cae3d-dc01-4039-b5ae-08345a9d04cf req-3dc63e18-95a7-483b-88f3-d1f162735590 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1977a5eb-902f-4527-8f10-5906b15eb26b", "tag": "3fc5ecd2-f964-4265-a360-ea772ea058f1"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:02.777021 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-691cae3d-dc01-4039-b5ae-08345a9d04cf req-3dc63e18-95a7-483b-88f3-d1f162735590 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:02.777499 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-691cae3d-dc01-4039-b5ae-08345a9d04cf req-3dc63e18-95a7-483b-88f3-d1f162735590 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:02.789329 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-691cae3d-dc01-4039-b5ae-08345a9d04cf req-3dc63e18-95a7-483b-88f3-d1f162735590 service nova] Creating event network-changed:3fc5ecd2-f964-4265-a360-ea772ea058f1 for instance 1977a5eb-902f-4527-8f10-5906b15eb26b on hv-cinder-81045 May 24 10:19:02.795232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-691cae3d-dc01-4039-b5ae-08345a9d04cf req-3dc63e18-95a7-483b-88f3-d1f162735590 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 May 24 10:19:02.797153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 279/556] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:03.037897 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-584369336", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "networks": [{"uuid": "10b937ae-23fb-4cb2-99d8-76c8cd98552f"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:03.054005 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:03.106887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] validate_networks() for [('10b937ae-23fb-4cb2-99d8-76c8cd98552f', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:19:03.301658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:03.302734 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:03.308153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:03.310308 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:03.315704 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:03.315704 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:03.315704 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:03.537657 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:03.547338 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a24338c5-9eb0-4b60-aaff-d78135b2e097 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.250520 May 24 10:19:03.547948 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 280/557] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:03 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:03.597761 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:19:03.598734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:19:03.599202 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:19:03.605786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:19:03.605786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:19:03.609810 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:03.610256 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:03.611149 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:03.611716 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:03.629220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Getting quotas for project 5cc2c0063a4443d2858152dd95bc074d. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:19:03.633651 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Getting quotas for user aa03c345613842c5a202aa30bc05b229 and project 5cc2c0063a4443d2858152dd95bc074d. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:19:03.645450 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:19:03.647743 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:19:03.760915 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cf987955-8d7a-4205-a5ac-d04e28ce459a tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727034 May 24 10:19:03.761673 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 278/558] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:19:03.771766 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f36581bf-4499-4bac-a86c-3f0c07045af0 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:03.772386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f36581bf-4499-4bac-a86c-3f0c07045af0 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:03.837572 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f36581bf-4499-4bac-a86c-3f0c07045af0 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:03.843956 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f36581bf-4499-4bac-a86c-3f0c07045af0 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1218 microversion: 2.1 time: 0.075910 May 24 10:19:03.844727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 281/559] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:03 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:04.565665 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:04.566274 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:04.572252 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:04.572737 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:04.573496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:04.573930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:04.706174 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:04.712386 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-46cf4aeb-d938-4ae2-a67d-685929531701 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.151577 May 24 10:19:04.712953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 279/560] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:04 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:19:04.866384 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:04.867018 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:04.874966 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:04.877612 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:04.877612 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:04.877612 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:04.946026 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:04.955055 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-76d16938-f405-49ef-923d-d12ec396bace tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1222 microversion: 2.1 time: 0.095906 May 24 10:19:04.955055 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 282/561] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:04 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1222 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:05.095294 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-9be75e40-ae24-47a8-a0f1-89c34f9dcd6e req-b25b2fc6-e986-4049-bd31-232f1c1a505b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a59bc4-faf8-4394-9fc6-fd0acdf1215a", "name": "network-vif-plugged", "status": "completed", "tag": "91a43870-9dca-42b2-a5c1-b943d1673abb"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:05.118579 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-9be75e40-ae24-47a8-a0f1-89c34f9dcd6e req-b25b2fc6-e986-4049-bd31-232f1c1a505b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:05.118726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-9be75e40-ae24-47a8-a0f1-89c34f9dcd6e req-b25b2fc6-e986-4049-bd31-232f1c1a505b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:05.135428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-9be75e40-ae24-47a8-a0f1-89c34f9dcd6e req-b25b2fc6-e986-4049-bd31-232f1c1a505b service nova] Creating event network-vif-plugged:91a43870-9dca-42b2-a5c1-b943d1673abb for instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a on hv-cinder-81045 May 24 10:19:05.140219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-9be75e40-ae24-47a8-a0f1-89c34f9dcd6e req-b25b2fc6-e986-4049-bd31-232f1c1a505b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049663 May 24 10:19:05.141621 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 280/562] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:19:05.729656 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:05.730431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:05.737299 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:05.737944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:05.741213 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:05.741213 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:05.874665 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:05.883142 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0e0dd989-50ae-411b-af31-b3999fdf943e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.157578 May 24 10:19:05.883719 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 283/563] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:05 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:05.972119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:05.972706 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:05.978758 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:05.979272 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:05.979979 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:05.980408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:06.041456 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:06.049230 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-db34086e-a6f9-4edf-9507-fe56237db0b7 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1278 microversion: 2.1 time: 0.082224 May 24 10:19:06.049798 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 281/564] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:05 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:06.901118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:06.902443 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:06.911265 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:06.912071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:06.912918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:06.913566 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:07.049917 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:07.057289 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-82bdd173-5410-4787-8f05-9ee62d3f4862 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1365 microversion: 2.1 time: 0.160172 May 24 10:19:07.057858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 284/565] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:06 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:07.065854 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:07.066465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:07.072852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:07.073296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:07.074055 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:07.074489 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:07.208742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:07.216651 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6130312f-ddaa-41f6-96b9-51f17c102b6f tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.154968 May 24 10:19:07.217225 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 282/566] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:07 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:08.074359 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:08.074954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:08.081429 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:08.081874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:08.082632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:08.083322 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:08.129697 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-570c96c1-d1f3-4950-adb7-e0f535dcda92 req-a15e90ce-68e0-4311-8871-d777ecc13401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c6062c-714c-4eab-a4bb-1860bf1219cb", "tag": "0f2e54d5-84f0-4d35-a3f8-7f48780a117f"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:08.145031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-570c96c1-d1f3-4950-adb7-e0f535dcda92 req-a15e90ce-68e0-4311-8871-d777ecc13401 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:08.148242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-570c96c1-d1f3-4950-adb7-e0f535dcda92 req-a15e90ce-68e0-4311-8871-d777ecc13401 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:08.157966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-570c96c1-d1f3-4950-adb7-e0f535dcda92 req-a15e90ce-68e0-4311-8871-d777ecc13401 service nova] Creating event network-changed:0f2e54d5-84f0-4d35-a3f8-7f48780a117f for instance 76c6062c-714c-4eab-a4bb-1860bf1219cb on hv-cinder-81045 May 24 10:19:08.162780 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-570c96c1-d1f3-4950-adb7-e0f535dcda92 req-a15e90ce-68e0-4311-8871-d777ecc13401 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037098 May 24 10:19:08.163379 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 283/567] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:19:08.224525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:08.234504 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:08.235167 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9475d830-3748-4958-812c-b152c88b2b67 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1555 microversion: 2.1 time: 0.164445 May 24 10:19:08.235325 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:08.236023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 285/568] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:08 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:08.241987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:08.242431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:08.243192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:08.243685 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:08.252260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-eec7a843-df84-41b8-a611-e3ebce16d604 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:08.252902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-eec7a843-df84-41b8-a611-e3ebce16d604 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:08.258952 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:08.259176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eec7a843-df84-41b8-a611-e3ebce16d604 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:08.260091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eec7a843-df84-41b8-a611-e3ebce16d604 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:08.261141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eec7a843-df84-41b8-a611-e3ebce16d604 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:08.261285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eec7a843-df84-41b8-a611-e3ebce16d604 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:08.374986 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-eec7a843-df84-41b8-a611-e3ebce16d604 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127034 May 24 10:19:08.375663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 286/569] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:19:08 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:08.412068 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:08.419956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8a743538-851c-4583-904a-405e9a6f2669 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.189555 May 24 10:19:08.420526 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 284/570] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:08 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:19:09.438098 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:09.438965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:09.445873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:09.446918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:09.447719 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:09.448712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:09.452327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:09.582549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:09.590331 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ba001f50-fba0-4474-9dba-6bb4560f2111 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.156746 May 24 10:19:09.590900 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 287/571] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:09 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:10.177305 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-b39d3cf1-9a40-4aa6-8b0a-b17bc3300200 req-7413aabe-c73f-4752-81c1-7dee9a579e05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a59bc4-faf8-4394-9fc6-fd0acdf1215a", "tag": "91a43870-9dca-42b2-a5c1-b943d1673abb"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:10.185645 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b39d3cf1-9a40-4aa6-8b0a-b17bc3300200 req-7413aabe-c73f-4752-81c1-7dee9a579e05 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:10.186083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b39d3cf1-9a40-4aa6-8b0a-b17bc3300200 req-7413aabe-c73f-4752-81c1-7dee9a579e05 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:10.199866 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-b39d3cf1-9a40-4aa6-8b0a-b17bc3300200 req-7413aabe-c73f-4752-81c1-7dee9a579e05 service nova] Creating event network-changed:91a43870-9dca-42b2-a5c1-b943d1673abb for instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a on hv-cinder-81045 May 24 10:19:10.202426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-b39d3cf1-9a40-4aa6-8b0a-b17bc3300200 req-7413aabe-c73f-4752-81c1-7dee9a579e05 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028892 May 24 10:19:10.203012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 285/572] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:10.607865 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:10.608839 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:10.615912 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:10.616532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:10.617410 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:10.617949 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:10.759298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:10.769004 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f5b0163a-b03d-4358-8c60-150c3121160c tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.164855 May 24 10:19:10.769687 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 288/573] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:10 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:11.787596 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:11.788221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:11.794348 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:11.794791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:11.795533 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:11.796004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:11.926991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:11.934350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-aefe6d84-aeb3-4a9e-b2de-17daac8ef835 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.152041 May 24 10:19:11.934906 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 286/574] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:11 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:12.950638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:12.951270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:12.958916 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:12.959363 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:12.960169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:12.960600 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:13.089712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:13.097810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ede6c4d3-37a2-45e8-bdfa-bb8e7cf95e41 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.151149 May 24 10:19:13.098389 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 289/575] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:12 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:14.114318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:14.114921 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:14.117377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:14.118031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:14.122746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:14.128600 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:14.128600 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:14.128600 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:14.252508 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:14.259925 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-43402817-f8a5-422a-9a82-e54faf7e60fc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.149377 May 24 10:19:14.260485 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 287/576] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:14 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:15.098281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-6680e571-5456-4745-8e04-eec22217a439 req-31b7bd2b-f4a2-4230-bed7-873e78dd0af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c6062c-714c-4eab-a4bb-1860bf1219cb", "name": "network-vif-plugged", "status": "completed", "tag": "0f2e54d5-84f0-4d35-a3f8-7f48780a117f"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:15.101885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:15.107098 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-6680e571-5456-4745-8e04-eec22217a439 req-31b7bd2b-f4a2-4230-bed7-873e78dd0af6 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:15.107535 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-6680e571-5456-4745-8e04-eec22217a439 req-31b7bd2b-f4a2-4230-bed7-873e78dd0af6 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:15.118244 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-6680e571-5456-4745-8e04-eec22217a439 req-31b7bd2b-f4a2-4230-bed7-873e78dd0af6 service nova] Creating event network-vif-plugged:0f2e54d5-84f0-4d35-a3f8-7f48780a117f for instance 76c6062c-714c-4eab-a4bb-1860bf1219cb on hv-cinder-81045 May 24 10:19:15.123250 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-6680e571-5456-4745-8e04-eec22217a439 req-31b7bd2b-f4a2-4230-bed7-873e78dd0af6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029212 May 24 10:19:15.123956 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 290/577] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:15.276887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:15.277478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:15.284526 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:15.284967 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:15.285720 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:15.286146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:15.419216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:15.427058 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-74753a7d-46d6-425b-85f4-ebfd8113be96 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.153964 May 24 10:19:15.427631 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 288/578] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:15 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:16.445223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:16.445954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:16.452829 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:16.453279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:16.454756 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:16.455191 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:16.583488 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:16.590901 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2c6102b1-f60f-4515-a5f7-fcbfb7cb6166 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1318 microversion: 2.1 time: 0.150488 May 24 10:19:16.591468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 291/579] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:16 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:17.608177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:17.608735 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:17.616041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:17.617223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:17.617336 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:17.617774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:17.921603 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:17.929874 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a3da69ee-0b73-4d81-91eb-4515aac950d6 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1506 microversion: 2.1 time: 0.325644 May 24 10:19:17.930448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 289/580] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:17 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1506 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:17.946278 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cf1edb29-561f-4491-8128-49d945c52fde tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cb3cfc4-e136-4284-9ba4-6bdeb087b217", "device": "/dev/sdb"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:17.947350 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cf1edb29-561f-4491-8128-49d945c52fde tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:17.954372 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf1edb29-561f-4491-8128-49d945c52fde tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:17.954812 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf1edb29-561f-4491-8128-49d945c52fde tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:17.955562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf1edb29-561f-4491-8128-49d945c52fde tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:17.956024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cf1edb29-561f-4491-8128-49d945c52fde tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:18.641695 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cf1edb29-561f-4491-8128-49d945c52fde tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "POST /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699167 May 24 10:19:18.642317 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 292/581] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:19:17 2022] POST /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:19:19.654198 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fb6fe0fb-d734-4b51-a0a3-440780cc3097 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:19.655129 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fb6fe0fb-d734-4b51-a0a3-440780cc3097 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:19.662149 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb6fe0fb-d734-4b51-a0a3-440780cc3097 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:19.662590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb6fe0fb-d734-4b51-a0a3-440780cc3097 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:19.663340 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb6fe0fb-d734-4b51-a0a3-440780cc3097 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:19.663768 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fb6fe0fb-d734-4b51-a0a3-440780cc3097 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:19.691086 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fb6fe0fb-d734-4b51-a0a3-440780cc3097 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040837 May 24 10:19:19.691624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 290/582] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:19:19 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:19:19.751539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:19.752132 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:19.758338 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:19.758781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:19.759537 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:19.759991 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:19.784765 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:19:20.074160 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e653e170-7850-4110-87d7-e6300287b0fb tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 204 len: 0 microversion: 2.1 time: 0.327011 May 24 10:19:20.074793 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 293/583] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:19:19 2022] DELETE /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:19:20.083896 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:20.084510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:20.090704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:20.091150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:20.091930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:20.092360 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:20.222132 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:20.227581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-70aa6aa8-ae35-4534-9233-d73a8a82e6b2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1673 microversion: 2.1 time: 0.148502 May 24 10:19:20.228181 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 291/584] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:20 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:21.246063 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:21.246748 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:21.253271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:21.253712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:21.254462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:21.254890 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:21.432514 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:21.440522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-90dc758c-d1a1-4ecb-9c88-f85eb75624e6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1673 microversion: 2.1 time: 0.198601 May 24 10:19:21.441062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 294/585] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:21 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:22.465682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:22.466479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:22.473123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:22.473641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:22.474412 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:22.474844 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:22.608867 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:22.617173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b400cd50-972c-4dcf-99ec-7a191dc65492 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1673 microversion: 2.1 time: 0.155542 May 24 10:19:22.617734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 292/586] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:22 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:23.634474 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:23.635204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:23.642062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:23.642509 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:23.643284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:23.643711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:23.709674 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:23.717486 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1c6c96b9-34f6-442e-a282-b6d4268ad941 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1605 microversion: 2.1 time: 0.086766 May 24 10:19:23.719872 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 295/587] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:23 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:23.784525 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-0e18b238-2b91-4c15-b14b-df2537b7cac3 req-5692644f-f5a0-4cd8-84a1-428ac693e3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8b45da9-b689-4ab8-aa70-2b00c4b687f5", "name": "network-vif-deleted", "tag": "1b36d170-d593-4b40-ac32-fe6f8b4e2ca0"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:23.793463 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-0e18b238-2b91-4c15-b14b-df2537b7cac3 req-5692644f-f5a0-4cd8-84a1-428ac693e3aa service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:23.793907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-0e18b238-2b91-4c15-b14b-df2537b7cac3 req-5692644f-f5a0-4cd8-84a1-428ac693e3aa service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:23.805577 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-0e18b238-2b91-4c15-b14b-df2537b7cac3 req-5692644f-f5a0-4cd8-84a1-428ac693e3aa service nova] Creating event network-vif-deleted:1b36d170-d593-4b40-ac32-fe6f8b4e2ca0 for instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 on hv-cinder-81045 May 24 10:19:23.811250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-0e18b238-2b91-4c15-b14b-df2537b7cac3 req-5692644f-f5a0-4cd8-84a1-428ac693e3aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031283 May 24 10:19:23.811917 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 293/588] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:19:24.734714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:24.735547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:24.742071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:24.745881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:24.745881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:24.745881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:24.775773 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:24.776270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:24.776718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lazy-loading 'fault' on Instance uuid c8b45da9-b689-4ab8-aa70-2b00c4b687f5 {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:19:24.817689 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:24.825151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3427b61f-1507-43a5-b7aa-88df9c31ce8e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 200 len: 1326 microversion: 2.1 time: 0.094447 May 24 10:19:24.825714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 296/589] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:24 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 1326 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:25.843040 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:25.843755 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:25.850437 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:25.850881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:25.851630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:25.852087 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:25.867495 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] HTTP exception thrown: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Request method failure captured: May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 HTTP/1.1 May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAJtoKVxNt5Y5R5lDaAs97xn-oQ65xrtxIw8AKBaV_gaszHfuNV9wojURWZoZLE9oqTMmb0Ims5SjrQecms4lIIaxlOJaohEPb1RAHCIR5RGBqLnb2l4e52Usj77JnOjn4WCxZ6mhx2pQ24wJnqFrkVTUrS2UQIua86D90Bjdo0pQA May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:19:25.869137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec0a495fa51c4f038a6d18b3185bcbb0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeTestJSON-1808574469 May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: eec86bb8790745aaaa45b6d9e4d94ca7 May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:19:25.870590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': 'c8b45da9-b689-4ab8-aa70-2b00c4b687f5'} May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:19:25.871408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:19:25.872801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:25.873931 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Returning 404 to user: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:19:25.873931 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-62f7152c-c860-4d84-a37a-208b40b4b82d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 404 len: 111 microversion: 2.1 time: 0.031762 May 24 10:19:25.873931 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 294/590] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:25 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:19:25.880150 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d285cea0-03b6-4c8a-88b0-6218c6c5d760 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '.version_select at 0x7ff63ae45ee0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:25.955695 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d285cea0-03b6-4c8a-88b0-6218c6c5d760 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724932619" status: 202 len: 0 microversion: 2.1 time: 0.079190 May 24 10:19:25.956312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 297/591] 10.222.0.44 () {58 vars in 1217 bytes} [Tue May 24 10:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724932619 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:19:26.735417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-11f3ecc5-f614-491e-91c3-99245b37c6b0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'create', calling method: .version_select at 0x7ff63aebb940>, body: {"keypair": {"name": "tempest-keypair-1883898905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN54Rc8yxsJJ4Kow17zfMRHqY8LbOqumyCjTau4h3IAf+EBSlVGIA1a3g8ApJdh32MtOX3uSjlsmjfxT8oFxE37fWzP7WNPatcrkKGtQQ3I+Cz9KL5mKFoYtLh45uw0RTw=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:26.749102 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-11f3ecc5-f614-491e-91c3-99245b37c6b0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:19:26.753643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-11f3ecc5-f614-491e-91c3-99245b37c6b0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for user eec86bb8790745aaaa45b6d9e4d94ca7 and project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:19:26.827231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-11f3ecc5-f614-491e-91c3-99245b37c6b0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095690 May 24 10:19:26.827843 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 295/592] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:19:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:29.167175 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1090105942", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0108d856-6f4b-41f3-afa6-b1ae3c7d6339"}], "security_groups": [{"name": "tempest-securitygroup--1520458041"}], "key_name": "tempest-keypair-1883898905", "user_data": "}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:29.265336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] validate_networks() for [('0108d856-6f4b-41f3-afa6-b1ae3c7d6339', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:19:29.662188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:19:29.662613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:19:29.663084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:19:29.663489 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:19:29.663939 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:19:29.673419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:29.673865 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:29.674662 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:29.675095 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:29.691455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:19:29.695385 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Getting quotas for user eec86bb8790745aaaa45b6d9e4d94ca7 and project ec0a495fa51c4f038a6d18b3185bcbb0. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:19:29.706395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:19:29.708940 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:19:29.827268 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e7aececb-2d3f-4581-81bb-9407362d1b28 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664412 May 24 10:19:29.827945 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 298/593] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:19:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:19:29.838227 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c45574bb-6908-4a67-af48-8689b7893d63 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:29.838947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c45574bb-6908-4a67-af48-8689b7893d63 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:29.897271 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c45574bb-6908-4a67-af48-8689b7893d63 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:29.905111 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c45574bb-6908-4a67-af48-8689b7893d63 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1238 microversion: 2.1 time: 0.070717 May 24 10:19:29.905674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 296/594] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:29 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:30.923114 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:30.924019 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:30.930722 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:30.931172 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:30.932049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:30.932421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:30.995714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:31.003290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-65e194aa-8ee8-4b3a-b560-5c1a434bffce tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1242 microversion: 2.1 time: 0.084646 May 24 10:19:31.003871 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 299/595] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:30 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:32.020093 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:32.020702 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:32.026723 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:32.029916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:32.029916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:32.029916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:32.096504 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:32.105494 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-69cb2c96-48f2-446d-8751-43eca1d9459a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1298 microversion: 2.1 time: 0.089288 May 24 10:19:32.106070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 297/596] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:32 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:33.123154 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:33.123700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:33.131206 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:33.131655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:33.132494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:33.132894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:33.259059 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:33.266735 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b854c328-f91e-4985-bbdd-ebc41188e127 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.147280 May 24 10:19:33.267299 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 300/597] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:33 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:34.283639 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:34.284198 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:34.286578 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:34.291240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:34.291681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:34.292488 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:34.292921 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:34.421274 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:34.429470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1704a1fc-b014-4baf-8eba-ef1e23ca2042 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.149683 May 24 10:19:34.430037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 298/598] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:34 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:35.501531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:35.502138 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:35.504073 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:35.508697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:35.509144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:35.509896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:35.510362 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:35.653764 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:35.662462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ab78fc99-19a7-4ab7-9db5-c09d8a1d8e0d tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.220639 May 24 10:19:35.663268 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 301/599] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:35 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:35.875744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-a07a660d-fe89-470c-bd85-94230a787617 req-cd60a613-462e-4694-a400-207fe85aaf80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d13e704-de25-497a-b01b-585c5b4207aa", "tag": "e078a98e-6d66-4de7-bd2d-157212764871"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:35.886326 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a07a660d-fe89-470c-bd85-94230a787617 req-cd60a613-462e-4694-a400-207fe85aaf80 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:35.887276 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a07a660d-fe89-470c-bd85-94230a787617 req-cd60a613-462e-4694-a400-207fe85aaf80 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:35.902364 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-a07a660d-fe89-470c-bd85-94230a787617 req-cd60a613-462e-4694-a400-207fe85aaf80 service nova] Creating event network-changed:e078a98e-6d66-4de7-bd2d-157212764871 for instance 6d13e704-de25-497a-b01b-585c5b4207aa on hv-cinder-81045 May 24 10:19:35.906750 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-a07a660d-fe89-470c-bd85-94230a787617 req-cd60a613-462e-4694-a400-207fe85aaf80 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034535 May 24 10:19:35.907364 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 299/600] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:36.680642 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:36.681237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:36.689426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:36.689869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:36.690635 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:36.691061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:36.816924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:36.820369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:36.824557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c7996810-6afd-47f8-b413-0e534ede10de tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.147722 May 24 10:19:36.825131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 302/601] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:36 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:19:37.842484 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:37.843186 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:37.849749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:37.850202 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:37.850969 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:37.851407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:37.983446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:37.990889 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c9b862c0-30c5-47bc-9b58-b5c07df55759 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.153159 May 24 10:19:37.991452 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 300/602] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:37 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:38.893919 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:38.894460 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:38.901560 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:38.902001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:38.902771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:38.903198 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:38.982234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lazy-loading 'services' on Instance uuid 1977a5eb-902f-4527-8f10-5906b15eb26b {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:19:39.007878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:39.008591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:39.015146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:39.015658 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:39.016447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:39.016876 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:39.019571 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=73 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:39.144563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:39.151633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-133f3cbe-4363-43a3-8cac-ef2a7684e06f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.147626 May 24 10:19:39.152219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 301/603] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:39 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:39.222548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7b9e466f-5050-47c5-bdcf-6a5bf1070f1a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments/5220e8e1-ff9d-4291-bc04-e0a8453c0329" status: 202 len: 0 microversion: 2.1 time: 0.333093 May 24 10:19:39.223062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 303/604] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:19:38 2022] DELETE /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments/5220e8e1-ff9d-4291-bc04-e0a8453c0329 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:19:39.232150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0dfb4492-751f-4fd6-8bf9-c1a30ba4a801 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:39.234259 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0dfb4492-751f-4fd6-8bf9-c1a30ba4a801 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:39.239233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfb4492-751f-4fd6-8bf9-c1a30ba4a801 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:39.239685 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfb4492-751f-4fd6-8bf9-c1a30ba4a801 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:39.240480 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfb4492-751f-4fd6-8bf9-c1a30ba4a801 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:39.240920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0dfb4492-751f-4fd6-8bf9-c1a30ba4a801 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:39.270065 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0dfb4492-751f-4fd6-8bf9-c1a30ba4a801 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042297 May 24 10:19:39.270616 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 302/605] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:19:39 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:39.606713 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:39.607310 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:39.613742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:39.614180 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:39.614934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:39.615362 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:39.682226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:39.693942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lazy-loading 'services' on Instance uuid 76c6062c-714c-4eab-a4bb-1860bf1219cb {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:19:39.704488 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=6 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:39.867332 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-95af4c24-e3ac-49dc-b1b4-6e86ade4e7d5 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "DELETE /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb/os-volume_attachments/7cb3cfc4-e136-4284-9ba4-6bdeb087b217" status: 202 len: 0 microversion: 2.1 time: 0.264594 May 24 10:19:39.867899 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 304/606] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:19:39 2022] DELETE /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb/os-volume_attachments/7cb3cfc4-e136-4284-9ba4-6bdeb087b217 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:19:40.168601 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:40.169143 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:40.170952 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:40.176785 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:40.177231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:40.177988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:40.178419 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:40.284010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e1e916a0-9da8-4c67-8939-847b1a7b8b43 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:40.285130 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e1e916a0-9da8-4c67-8939-847b1a7b8b43 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:40.291633 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1e916a0-9da8-4c67-8939-847b1a7b8b43 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:40.292118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1e916a0-9da8-4c67-8939-847b1a7b8b43 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:40.292883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1e916a0-9da8-4c67-8939-847b1a7b8b43 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:40.293318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1e916a0-9da8-4c67-8939-847b1a7b8b43 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:40.312149 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:40.320300 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d1a94b64-d46e-444d-9f43-e2087821bcf6 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.155292 May 24 10:19:40.320892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 303/607] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:40 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:40.326549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e1e916a0-9da8-4c67-8939-847b1a7b8b43 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048258 May 24 10:19:40.327281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 305/608] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:19:40 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:19:41.338699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:41.339526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-991453df-56a9-488f-8d8d-cf44e90fbe45 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:41.340781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-991453df-56a9-488f-8d8d-cf44e90fbe45 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:41.341463 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:41.350591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.351278 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.351626 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-991453df-56a9-488f-8d8d-cf44e90fbe45 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.352001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.352112 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-991453df-56a9-488f-8d8d-cf44e90fbe45 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.352432 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.352877 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-991453df-56a9-488f-8d8d-cf44e90fbe45 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.353310 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-991453df-56a9-488f-8d8d-cf44e90fbe45 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.393759 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-991453df-56a9-488f-8d8d-cf44e90fbe45 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058661 May 24 10:19:41.394441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 306/609] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:19:41 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:19:41.479498 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:41.480110 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:41.486360 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.486911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.487837 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.488353 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.492492 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:41.499900 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e06ddfe2-bc5d-434c-93ff-41a48bd53a60 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.165282 May 24 10:19:41.500465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 304/610] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:41 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:41.513875 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:19:41.740458 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-22cbc163-6c82-454f-8fae-1549c42b8f6a tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 204 len: 0 microversion: 2.1 time: 0.264484 May 24 10:19:41.741077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 307/611] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:19:41 2022] DELETE /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:19:41.749120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:41.749882 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:41.756291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.756750 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.757520 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:41.757957 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:41.889185 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:41.897235 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6b61ee9a-6be9-46ff-8fcc-f405e73173d5 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1688 microversion: 2.1 time: 0.152157 May 24 10:19:41.897789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 305/612] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:41 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:42.029360 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:42.029942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:42.036170 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.036615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:42.037367 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.037796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:42.064819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:19:42.340092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5dbace47-06b6-494b-bc23-0b813a559b52 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "DELETE /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 204 len: 0 microversion: 2.1 time: 0.314588 May 24 10:19:42.340697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 308/613] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:19:42 2022] DELETE /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:19:42.349360 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:42.349962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:42.356346 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.356783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:42.357527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.357951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:42.486085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:42.493564 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5b942973-02a1-4cc6-a0c5-350397526697 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1512 microversion: 2.1 time: 0.148020 May 24 10:19:42.498466 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 306/614] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:42 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:42.517253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:42.517873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:42.524258 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.524701 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:42.525457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.525889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:42.650950 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:42.658925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7381d280-1ebf-4e5d-8bf4-7a8cde71228a tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.145872 May 24 10:19:42.659608 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 309/615] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:42 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:42.914215 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:42.914820 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:42.920827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.921275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:42.922070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:42.922499 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:43.050718 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:43.058046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f0ed3668-6544-45e3-b3bf-8e2bd27a7430 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1688 microversion: 2.1 time: 0.147652 May 24 10:19:43.058609 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 307/616] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:42 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:43.280212 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-96ff48ca-f573-4a23-997e-aceee8a7531e req-e8930b91-5f3e-4cce-910c-8615753474f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d13e704-de25-497a-b01b-585c5b4207aa", "name": "network-vif-plugged", "status": "completed", "tag": "e078a98e-6d66-4de7-bd2d-157212764871"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:43.288199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-96ff48ca-f573-4a23-997e-aceee8a7531e req-e8930b91-5f3e-4cce-910c-8615753474f4 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:43.288640 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-96ff48ca-f573-4a23-997e-aceee8a7531e req-e8930b91-5f3e-4cce-910c-8615753474f4 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:43.299508 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-96ff48ca-f573-4a23-997e-aceee8a7531e req-e8930b91-5f3e-4cce-910c-8615753474f4 service nova] Creating event network-vif-plugged:e078a98e-6d66-4de7-bd2d-157212764871 for instance 6d13e704-de25-497a-b01b-585c5b4207aa on hv-cinder-81045 May 24 10:19:43.304525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-96ff48ca-f573-4a23-997e-aceee8a7531e req-e8930b91-5f3e-4cce-910c-8615753474f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028522 May 24 10:19:43.305109 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 310/617] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:43.510424 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:43.511029 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:43.517493 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:43.517938 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:43.518695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:43.519128 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:43.643069 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:43.650414 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-053f60ab-ef75-4a40-8c61-46816f3d48bc tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1512 microversion: 2.1 time: 0.143838 May 24 10:19:43.650968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 308/618] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:43 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1512 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:43.679130 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:43.679837 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:43.686381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:43.686822 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:43.688391 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:43.688824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:43.816852 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:43.824279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-43e601e9-3bca-4812-80bd-a9a7f9577655 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.149202 May 24 10:19:43.824851 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 311/619] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:43 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:44.075280 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:44.075918 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:44.081895 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:44.082350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:44.083107 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:44.083883 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:44.207598 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:44.215156 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a76da2a8-e0c4-4eca-b495-2e11afc97d83 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1688 microversion: 2.1 time: 0.143712 May 24 10:19:44.215719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 309/620] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:44 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1688 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:44.667095 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:44.667701 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:44.673862 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:44.674301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:44.675060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:44.675478 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:44.800358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:44.807883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5731b8e3-ab66-4a33-8b1f-f3511a82d67b tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1512 microversion: 2.1 time: 0.144644 May 24 10:19:44.808449 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 312/621] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:44 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:44.840302 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:44.840907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:44.847446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:44.847927 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:44.848688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:44.849136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:44.977885 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:44.985925 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-96e3ad21-5034-4abf-8a44-6848f3b5e36e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.149406 May 24 10:19:44.986499 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 310/622] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:44 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:45.231704 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:45.232330 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:45.239140 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:45.239611 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:45.240397 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:45.240828 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:45.365515 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:45.372859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f531b145-f6fb-4633-980d-86f4b5198905 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1688 microversion: 2.1 time: 0.144972 May 24 10:19:45.373422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 313/623] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:45 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1688 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:45.825264 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:45.825865 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:45.831838 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:45.832284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:45.833037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:45.833725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:45.960483 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:45.967720 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b47560b3-c720-4b55-8933-9c51b2cd5301 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1512 microversion: 2.1 time: 0.146284 May 24 10:19:45.968873 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 311/624] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:45 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:46.003222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:46.003846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:46.010250 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:46.010692 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:46.011446 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:46.011896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:46.137150 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:46.145130 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2a0510ce-7e03-45db-bac6-ae3c5e5c6ed2 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.146685 May 24 10:19:46.145725 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 314/625] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:45 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:46.391104 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:46.391661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:46.397655 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:46.398102 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:46.398854 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:46.399283 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:46.526837 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:46.534384 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-44629511-d95b-46c6-9d67-18c8f2d47c0f tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1688 microversion: 2.1 time: 0.147821 May 24 10:19:46.534950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 312/626] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:46 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1688 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:46.985539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:46.986076 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:46.992195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:46.992641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:46.993421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:46.993847 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:47.011603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:47.120324 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:47.127969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1651415e-9ae3-4626-81c6-1112ad7fcb60 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1512 microversion: 2.1 time: 0.146958 May 24 10:19:47.128536 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 315/627] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:46 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:47.162959 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:47.164334 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:47.171175 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:47.172282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:47.173123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:47.173667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:47.401457 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:47.409912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2cf4479c-6576-4d98-a0f9-139d5ee87ae5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.250804 May 24 10:19:47.410815 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 313/628] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:47 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:47.552191 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:47.552706 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:47.561085 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:47.562548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:47.563142 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:47.563633 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:47.762569 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:47.774770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f17abe49-4960-4f2d-9f0a-45963ecc40ea tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1688 microversion: 2.1 time: 0.228077 May 24 10:19:47.775541 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 316/629] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:47 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:47.831849 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-dc8bfab0-69c9-4314-81c5-15ad7f80e429 req-cf9134d4-07a0-4d7d-bf98-aa46ca3792e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c6062c-714c-4eab-a4bb-1860bf1219cb", "name": "network-vif-deleted", "tag": "0f2e54d5-84f0-4d35-a3f8-7f48780a117f"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:47.840321 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-dc8bfab0-69c9-4314-81c5-15ad7f80e429 req-cf9134d4-07a0-4d7d-bf98-aa46ca3792e2 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:47.840765 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-dc8bfab0-69c9-4314-81c5-15ad7f80e429 req-cf9134d4-07a0-4d7d-bf98-aa46ca3792e2 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:47.852116 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-dc8bfab0-69c9-4314-81c5-15ad7f80e429 req-cf9134d4-07a0-4d7d-bf98-aa46ca3792e2 service nova] Creating event network-vif-deleted:0f2e54d5-84f0-4d35-a3f8-7f48780a117f for instance 76c6062c-714c-4eab-a4bb-1860bf1219cb on hv-cinder-81045 May 24 10:19:47.857152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-dc8bfab0-69c9-4314-81c5-15ad7f80e429 req-cf9134d4-07a0-4d7d-bf98-aa46ca3792e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099867 May 24 10:19:47.857741 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 314/630] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:48.145445 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:48.145574 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:48.152613 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:48.153569 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:48.154484 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:48.154920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:48.226490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-0103724c-cb01-42ff-8a88-67f6eb0f876d req-da1eb6c0-96e3-4fee-9bcd-218855a5cdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1977a5eb-902f-4527-8f10-5906b15eb26b", "name": "network-vif-deleted", "tag": "3fc5ecd2-f964-4265-a360-ea772ea058f1"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:48.236314 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:48.245072 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-0103724c-cb01-42ff-8a88-67f6eb0f876d req-da1eb6c0-96e3-4fee-9bcd-218855a5cdb7 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:48.245353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0d91efe3-c188-4107-b883-1f6495da72d4 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1303 microversion: 2.1 time: 0.104916 May 24 10:19:48.248723 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-0103724c-cb01-42ff-8a88-67f6eb0f876d req-da1eb6c0-96e3-4fee-9bcd-218855a5cdb7 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:48.256254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 315/631] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:48 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:19:48.267962 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-0103724c-cb01-42ff-8a88-67f6eb0f876d req-da1eb6c0-96e3-4fee-9bcd-218855a5cdb7 service nova] Creating event network-vif-deleted:3fc5ecd2-f964-4265-a360-ea772ea058f1 for instance 1977a5eb-902f-4527-8f10-5906b15eb26b on hv-cinder-81045 May 24 10:19:48.273659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-0103724c-cb01-42ff-8a88-67f6eb0f876d req-da1eb6c0-96e3-4fee-9bcd-218855a5cdb7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135106 May 24 10:19:48.274371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 317/632] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:48.427475 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:48.428202 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:48.448653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:48.448653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:48.449334 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:48.449753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:48.579856 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:48.587711 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-644c3935-137e-415a-8948-b7e96edc8a90 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1364 microversion: 2.1 time: 0.164052 May 24 10:19:48.588278 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 316/633] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:48 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:48.792671 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:48.793475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:48.800156 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:48.800610 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:48.801377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:48.801819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:48.876239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:48.884739 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-12798701-9e12-4dc5-959b-8c00d9305186 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1330 microversion: 2.1 time: 0.096245 May 24 10:19:48.885316 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 318/634] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:48 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1330 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:49.262241 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:49.262859 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:49.270313 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.270750 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.281219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.281219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.302409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.302848 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.303289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lazy-loading 'fault' on Instance uuid 76c6062c-714c-4eab-a4bb-1860bf1219cb {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:19:49.345692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa03c345613842c5a202aa30bc05b229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cc2c0063a4443d2858152dd95bc074d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:49.353354 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b70ca713-00a3-47ae-85fa-390203993933 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 200 len: 1308 microversion: 2.1 time: 0.094945 May 24 10:19:49.353915 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 317/635] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:49 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:49.605467 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:49.606071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:49.613272 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.617668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.617668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.617668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.747651 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:49.758771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-016cfd9b-f169-489e-a99f-249118614e7b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1551 microversion: 2.1 time: 0.156788 May 24 10:19:49.760187 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 319/636] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:49 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:49.784001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9cdc7c69-2a36-4ca3-a14c-36ff0cee31d4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:49.784818 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9cdc7c69-2a36-4ca3-a14c-36ff0cee31d4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:49.790946 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cdc7c69-2a36-4ca3-a14c-36ff0cee31d4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.791389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cdc7c69-2a36-4ca3-a14c-36ff0cee31d4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.792177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cdc7c69-2a36-4ca3-a14c-36ff0cee31d4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.792823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9cdc7c69-2a36-4ca3-a14c-36ff0cee31d4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.795447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:19:49.882515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9cdc7c69-2a36-4ca3-a14c-36ff0cee31d4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102847 May 24 10:19:49.887264 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 318/637] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:19:49 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:49.901727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:49.902630 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:49.910548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.911944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.912304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.912845 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.955319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:49.955833 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:49.956323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lazy-loading 'fault' on Instance uuid 1977a5eb-902f-4527-8f10-5906b15eb26b {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:19:50.005420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:50.016278 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-de9a3134-6182-4982-aaf6-894137d04c6c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 200 len: 1335 microversion: 2.1 time: 0.117935 May 24 10:19:50.025399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 320/638] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:49 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 1335 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:50.370560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:50.371183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] [instance: 76c6062c-714c-4eab-a4bb-1860bf1219cb] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:50.377823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:50.378279 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:50.379087 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:50.379529 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:50.396836 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] HTTP exception thrown: Instance 76c6062c-714c-4eab-a4bb-1860bf1219cb could not be found. May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Request method failure captured: May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb HTTP/1.1 May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLCwAwL-KqDZKJXLc0KB6wE1n7KkT4ho3VMIpANLwRjtfg5TwFC2azcMzNxAp3slQ1yRQFv1iQWlkjf8_hlyRAmLhHaLtDfjfKo2mgg7cTRPJFd3mCOhfS6yaaXbZhlq4CSDP2PCbKSM2XgAUKyhAGTbtzQ8f_noXnA6k-YO0xC0wDQ May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 5cc2c0063a4443d2858152dd95bc074d May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1881091484 May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:19:50.404370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5cc2c0063a4443d2858152dd95bc074d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5cc2c0063a4443d2858152dd95bc074d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5cc2c0063a4443d2858152dd95bc074d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5cc2c0063a4443d2858152dd95bc074d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotTestJSON-1881091484 May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 5cc2c0063a4443d2858152dd95bc074d May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1881091484 May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotTestJSON-1881091484-project May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: aa03c345613842c5a202aa30bc05b229 May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotTestJSON-1881091484-project May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 76c6062c-714c-4eab-a4bb-1860bf1219cb could not be found. May 24 10:19:50.406770 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '76c6062c-714c-4eab-a4bb-1860bf1219cb'} May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c6062c-714c-4eab-a4bb-1860bf1219cb could not be found. May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:19:50.408399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c6062c-714c-4eab-a4bb-1860bf1219cb could not be found. May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c6062c-714c-4eab-a4bb-1860bf1219cb could not be found. May 24 10:19:50.411001 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:50.412337 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] Returning 404 to user: Instance 76c6062c-714c-4eab-a4bb-1860bf1219cb could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:19:50.412337 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9d15f4a7-3966-45df-aca1-d6780f8e5971 tempest-VolumesSnapshotTestJSON-1881091484 tempest-VolumesSnapshotTestJSON-1881091484-project] 10.222.0.44 "GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb" status: 404 len: 111 microversion: 2.1 time: 0.036592 May 24 10:19:50.412337 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 319/639] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:50 2022] GET /compute/v2.1/servers/76c6062c-714c-4eab-a4bb-1860bf1219cb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:19:50.785858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d6692677-4bbe-4b4a-92a7-3342a7326080 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:50.786426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d6692677-4bbe-4b4a-92a7-3342a7326080 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:50.792591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6692677-4bbe-4b4a-92a7-3342a7326080 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:50.793041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6692677-4bbe-4b4a-92a7-3342a7326080 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:50.793812 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6692677-4bbe-4b4a-92a7-3342a7326080 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:50.794249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6692677-4bbe-4b4a-92a7-3342a7326080 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:50.819645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d6692677-4bbe-4b4a-92a7-3342a7326080 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/ips" status: 200 len: 150 microversion: 2.1 time: 0.145767 May 24 10:19:50.820264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 321/640] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:19:50 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/ips => generated 150 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:51.033344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:51.033953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 1977a5eb-902f-4527-8f10-5906b15eb26b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:51.040279 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:51.040805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:51.046334 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:51.046334 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:51.056498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] HTTP exception thrown: Instance 1977a5eb-902f-4527-8f10-5906b15eb26b could not be found. May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Request method failure captured: May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b HTTP/1.1 May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijK_8tQi6wMxPCTc3pS2gwEbfG2aOiCJ01U6sf1SmGdU5szWloH5BU1k2nT4FISfY1tg_KZcBZ0N60ytyG7xNeF2_bRfGTo3syuKWH61tulbcqp789BMMnsv5DCeYdFwqr_1IIiLi6gklaukfv7nSQYCZPTJxZ7HAFVrC-cdLyhFTw7w May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:19:51.058318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_544ebc06855b4435b767c0cc885ec068", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 04058cb7cf374eba92fb7ee796084e20 May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 1977a5eb-902f-4527-8f10-5906b15eb26b could not be found. May 24 10:19:51.059936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '1977a5eb-902f-4527-8f10-5906b15eb26b'} May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1977a5eb-902f-4527-8f10-5906b15eb26b could not be found. May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:19:51.060984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1977a5eb-902f-4527-8f10-5906b15eb26b could not be found. May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1977a5eb-902f-4527-8f10-5906b15eb26b could not be found. May 24 10:19:51.062477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:19:51.063924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Returning 404 to user: Instance 1977a5eb-902f-4527-8f10-5906b15eb26b could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:19:51.063924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ede1b185-c687-4436-a0be-a9b9666dd48b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b" status: 404 len: 111 microversion: 2.1 time: 0.030962 May 24 10:19:51.063924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 320/641] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:51 2022] GET /compute/v2.1/servers/1977a5eb-902f-4527-8f10-5906b15eb26b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:19:51.070846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9d8ced9f-4d73-4cef-88ed-aef093f761c6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '.version_select at 0x7ff63ae3f430>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:51.153693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9d8ced9f-4d73-4cef-88ed-aef093f761c6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085875032" status: 202 len: 0 microversion: 2.1 time: 0.087846 May 24 10:19:51.154283 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 322/642] 10.222.0.44 () {58 vars in 1220 bytes} [Tue May 24 10:19:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085875032 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:19:51.238361 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-84575071-cc72-4b41-9734-e7092069d904 req-a9c16215-11bc-487c-a682-658f16645711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d13e704-de25-497a-b01b-585c5b4207aa", "tag": "e078a98e-6d66-4de7-bd2d-157212764871"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:51.246988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-84575071-cc72-4b41-9734-e7092069d904 req-a9c16215-11bc-487c-a682-658f16645711 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:51.247422 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-84575071-cc72-4b41-9734-e7092069d904 req-a9c16215-11bc-487c-a682-658f16645711 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:51.260254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-84575071-cc72-4b41-9734-e7092069d904 req-a9c16215-11bc-487c-a682-658f16645711 service nova] Creating event network-changed:e078a98e-6d66-4de7-bd2d-157212764871 for instance 6d13e704-de25-497a-b01b-585c5b4207aa on hv-cinder-81045 May 24 10:19:51.266707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-84575071-cc72-4b41-9734-e7092069d904 req-a9c16215-11bc-487c-a682-658f16645711 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032366 May 24 10:19:51.267792 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 321/643] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:52.538464 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-da6ca32b-4d85-4479-872a-a5bce10e9457 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed40dd55-f673-49ab-832c-e069184e67d8"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:52.539535 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-da6ca32b-4d85-4479-872a-a5bce10e9457 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:52.547415 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da6ca32b-4d85-4479-872a-a5bce10e9457 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:52.547913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da6ca32b-4d85-4479-872a-a5bce10e9457 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:52.553868 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da6ca32b-4d85-4479-872a-a5bce10e9457 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:52.553868 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da6ca32b-4d85-4479-872a-a5bce10e9457 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:53.266711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-da6ca32b-4d85-4479-872a-a5bce10e9457 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.732099 May 24 10:19:53.267327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 323/644] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:19:52 2022] POST /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:19:56.945518 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:56.946088 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:56.952792 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:56.953252 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:56.954075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:56.954519 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:56.978914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:19:57.319744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4bd710d9-9940-487d-89e1-699869d8b78c tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 204 len: 0 microversion: 2.1 time: 0.378871 May 24 10:19:57.320633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 322/645] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:19:56 2022] DELETE /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:19:57.335379 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:57.336108 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:57.342358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:57.343306 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:57.344092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:57.344524 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:57.472960 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:57.480989 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8fb1459f-93ef-4ca1-96eb-6955e512ca70 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1508 microversion: 2.1 time: 0.150698 May 24 10:19:57.481912 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 324/646] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:57 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:58.500667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:58.501380 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:58.507847 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:58.508331 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:58.509092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:58.509520 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:58.648170 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:58.656281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b978e558-02f2-4386-abd8-ce2182d61e89 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1508 microversion: 2.1 time: 0.159244 May 24 10:19:58.657052 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 323/647] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:58 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:59.675992 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:19:59.678696 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:19:59.683432 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:59.684048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:59.685622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:59.686069 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:59.757434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-45bdb32c-968a-4ed1-8439-92b5df136374 req-92f785b0-e89d-487f-81ba-2a4791fcb259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce032c3-2129-40d1-94b5-0c2b5f4aaa68", "name": "network-vif-deleted", "tag": "71fb9519-9e7e-466c-8ff2-8f15ff74dc15"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:19:59.767510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-45bdb32c-968a-4ed1-8439-92b5df136374 req-92f785b0-e89d-487f-81ba-2a4791fcb259 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:19:59.768032 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-45bdb32c-968a-4ed1-8439-92b5df136374 req-92f785b0-e89d-487f-81ba-2a4791fcb259 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:19:59.774339 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:19:59.782370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-45bdb32c-968a-4ed1-8439-92b5df136374 req-92f785b0-e89d-487f-81ba-2a4791fcb259 service nova] Creating event network-vif-deleted:71fb9519-9e7e-466c-8ff2-8f15ff74dc15 for instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 on hv-cinder-81045 May 24 10:19:59.785853 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ad2253ad-3c2f-43e6-8362-b0c4e810a59e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 200 len: 1466 microversion: 2.1 time: 0.113754 May 24 10:19:59.785853 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 325/648] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:19:59 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 1466 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:19:59.793366 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-45bdb32c-968a-4ed1-8439-92b5df136374 req-92f785b0-e89d-487f-81ba-2a4791fcb259 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039486 May 24 10:19:59.794276 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 324/649] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:00.799737 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:00.800415 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:00.807088 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:00.807544 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:00.808373 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:00.808849 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:00.822259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] HTTP exception thrown: Instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 could not be found. May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Request method failure captured: May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 HTTP/1.1 May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_8tQi6wMxPCTc3pS2gwEbfG2aOiCJ01U6sf1SmGdU5szWloH5BU1k2nT4FISfY1tg_KZcBZ0N60ytyG7xNeF2_bRfGTo3syuKWH61tulbcqp789BMMnsv5DCeYdFwqr_1IIiLi6gklaukfv7nSQYCZPTJxZ7HAFVrC-cdLyhFTw7w May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:20:00.823981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_544ebc06855b4435b767c0cc885ec068", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 04058cb7cf374eba92fb7ee796084e20 May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 could not be found. May 24 10:20:00.833226 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '3ce032c3-2129-40d1-94b5-0c2b5f4aaa68'} May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 could not be found. May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:20:00.834426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 could not be found. May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 could not be found. May 24 10:20:00.836049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:00.837406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Returning 404 to user: Instance 3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:20:00.837406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ebda0c26-61c3-4390-962d-101929b1814e tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68" status: 404 len: 111 microversion: 2.1 time: 0.029567 May 24 10:20:00.837406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 326/650] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:00 2022] GET /compute/v2.1/servers/3ce032c3-2129-40d1-94b5-0c2b5f4aaa68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:20:00.837673 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:00.837673 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:00.842751 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:00.843735 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:00.844537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:00.844973 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:00.869840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:20:01.199451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d126d6ed-22a1-4117-ba98-a35cc1b1d2e3 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 204 len: 0 microversion: 2.1 time: 0.368393 May 24 10:20:01.200087 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 325/651] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:20:00 2022] DELETE /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:20:01.208874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:01.209489 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:01.216232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:01.216626 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:01.217385 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:01.217929 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:01.346945 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:01.354338 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-eb740879-a1c9-4821-88eb-2714db96f756 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.149557 May 24 10:20:01.354907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 327/652] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:01 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:20:02.371238 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:02.371959 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:02.378429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:02.378875 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:02.379635 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:02.380101 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:02.513203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:02.521269 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-14812deb-0e95-4072-9eef-ec0a597fef36 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.154276 May 24 10:20:02.521835 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 326/653] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:02 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:03.538305 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:03.538926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:03.545373 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:03.546579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:03.547339 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:03.547770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:03.670236 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:03.678270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7a1a9380-3ba0-4056-b1ee-e37434192de0 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.143738 May 24 10:20:03.678829 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 328/654] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:03 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:04.699732 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:04.705774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:04.705774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:04.708286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:04.708988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:04.709746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:04.710180 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:04.841767 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:04.849695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dbf72089-4fb5-4436-88b5-67a5ab10916b tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.154016 May 24 10:20:04.850257 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 327/655] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:04 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:05.871114 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:05.871114 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:05.876904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:05.877359 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:05.878140 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:05.878575 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:06.024453 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:06.032330 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a5b23b3b-94a1-464e-be8d-e82609470315 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1522 microversion: 2.1 time: 0.169423 May 24 10:20:06.042186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 329/656] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:05 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:06.254834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-67457eba-5017-4222-abf4-5df39ed33721 req-5c690337-7f34-4ff2-a833-0b51b7825fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee5360b6-0f14-4294-b939-f78a1edf56e5", "name": "network-vif-deleted", "tag": "9226c32d-cef5-4afb-bbe7-9569cc180068"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:06.263654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-67457eba-5017-4222-abf4-5df39ed33721 req-5c690337-7f34-4ff2-a833-0b51b7825fa2 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:06.264151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-67457eba-5017-4222-abf4-5df39ed33721 req-5c690337-7f34-4ff2-a833-0b51b7825fa2 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:06.275010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-67457eba-5017-4222-abf4-5df39ed33721 req-5c690337-7f34-4ff2-a833-0b51b7825fa2 service nova] Creating event network-vif-deleted:9226c32d-cef5-4afb-bbe7-9569cc180068 for instance ee5360b6-0f14-4294-b939-f78a1edf56e5 on hv-cinder-81045 May 24 10:20:06.279630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-67457eba-5017-4222-abf4-5df39ed33721 req-5c690337-7f34-4ff2-a833-0b51b7825fa2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028585 May 24 10:20:06.280748 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 328/657] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:07.052043 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:07.052043 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:07.053222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:07.057937 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.058387 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.059150 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.059580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.094373 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.094815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.095257 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lazy-loading 'fault' on Instance uuid ee5360b6-0f14-4294-b939-f78a1edf56e5 {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:20:07.105802 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed40dd55-f673-49ab-832c-e069184e67d8"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:07.106940 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:07.118482 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.118951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.119788 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.121660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.138607 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04058cb7cf374eba92fb7ee796084e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544ebc06855b4435b767c0cc885ec068', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:07.147693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0a84fb20-c070-4cb6-84ae-e718754d95fd tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 200 len: 1311 microversion: 2.1 time: 0.101731 May 24 10:20:07.148471 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 330/658] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:07 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:07.204459 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Invalid volume: volume ed40dd55-f673-49ab-832c-e069184e67d8 is already attached to instances: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: POST /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments HTTP/1.1 May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 74 May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:20:07.206193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {"volumeAttachment": {"volumeId": "ed40dd55-f673-49ab-832c-e069184e67d8"}} May 24 10:20:07.208002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Invalid volume: volume ed40dd55-f673-49ab-832c-e069184e67d8 is already attached to instances: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'server_id': 'a9a59bc4-faf8-4394-9fc6-fd0acdf1215a', 'body': {'volumeAttachment': {'volumeId': 'ed40dd55-f673-49ab-832c-e069184e67d8'}}} May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ed40dd55-f673-49ab-832c-e069184e67d8 is already attached to instances: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:07.209250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ed40dd55-f673-49ab-832c-e069184e67d8 is already attached to instances: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:07.210769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ed40dd55-f673-49ab-832c-e069184e67d8 is already attached to instances: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 400 to user: Invalid volume: volume ed40dd55-f673-49ab-832c-e069184e67d8 is already attached to instances: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ae809a02-46ba-40b5-b8c3-b74c987e565f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106296 May 24 10:20:07.212290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 329/659] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:20:07 2022] POST /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 24 10:20:07.270040 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:07.270596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:07.287969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.287969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.287969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.287969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.360693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lazy-loading 'services' on Instance uuid a9a59bc4-faf8-4394-9fc6-fd0acdf1215a {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:20:07.570099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-acd1fe36-9d30-4e41-94a5-012fd080f645 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments/ed40dd55-f673-49ab-832c-e069184e67d8" status: 202 len: 0 microversion: 2.1 time: 0.303798 May 24 10:20:07.570712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 331/660] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:20:07 2022] DELETE /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments/ed40dd55-f673-49ab-832c-e069184e67d8 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:20:07.579656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-631968f1-9d3c-4803-b897-6b4a07935cdc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:07.580650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-631968f1-9d3c-4803-b897-6b4a07935cdc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:07.599966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-631968f1-9d3c-4803-b897-6b4a07935cdc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.599966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-631968f1-9d3c-4803-b897-6b4a07935cdc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.599966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-631968f1-9d3c-4803-b897-6b4a07935cdc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:07.599966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-631968f1-9d3c-4803-b897-6b4a07935cdc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:07.622257 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-631968f1-9d3c-4803-b897-6b4a07935cdc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047029 May 24 10:20:07.627819 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 330/661] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:20:07 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:08.165633 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:08.166284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] [instance: ee5360b6-0f14-4294-b939-f78a1edf56e5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:08.173158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:08.173640 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:08.174403 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:08.174842 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:08.178861 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:08.189209 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] HTTP exception thrown: Instance ee5360b6-0f14-4294-b939-f78a1edf56e5 could not be found. May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Request method failure captured: May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 HTTP/1.1 May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijK_8tQi6wMxPCTc3pS2gwEbfG2aOiCJ01U6sf1SmGdU5szWloH5BU1k2nT4FISfY1tg_KZcBZ0N60ytyG7xNeF2_bRfGTo3syuKWH61tulbcqp789BMMnsv5DCeYdFwqr_1IIiLi6gklaukfv7nSQYCZPTJxZ7HAFVrC-cdLyhFTw7w May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:20:08.190887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_544ebc06855b4435b767c0cc885ec068", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/544ebc06855b4435b767c0cc885ec068"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 544ebc06855b4435b767c0cc885ec068 May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2079102229 May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 04058cb7cf374eba92fb7ee796084e20 May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2079102229-project May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance ee5360b6-0f14-4294-b939-f78a1edf56e5 could not be found. May 24 10:20:08.199576 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'ee5360b6-0f14-4294-b939-f78a1edf56e5'} May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee5360b6-0f14-4294-b939-f78a1edf56e5 could not be found. May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:20:08.200982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee5360b6-0f14-4294-b939-f78a1edf56e5 could not be found. May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee5360b6-0f14-4294-b939-f78a1edf56e5 could not be found. May 24 10:20:08.203395 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:08.205237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] Returning 404 to user: Instance ee5360b6-0f14-4294-b939-f78a1edf56e5 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:20:08.205237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ea73f2b6-7383-480e-8865-9df153452fa6 tempest-ServerRescueNegativeTestJSON-2079102229 tempest-ServerRescueNegativeTestJSON-2079102229-project] 10.222.0.44 "GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5" status: 404 len: 111 microversion: 2.1 time: 0.031446 May 24 10:20:08.205237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 332/662] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:08 2022] GET /compute/v2.1/servers/ee5360b6-0f14-4294-b939-f78a1edf56e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:20:08.634656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c8460853-9464-49c3-9372-d6c59ea59572 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:08.635723 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c8460853-9464-49c3-9372-d6c59ea59572 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:08.643015 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8460853-9464-49c3-9372-d6c59ea59572 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:08.643469 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8460853-9464-49c3-9372-d6c59ea59572 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:08.647955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8460853-9464-49c3-9372-d6c59ea59572 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:08.654225 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c8460853-9464-49c3-9372-d6c59ea59572 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:08.685276 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c8460853-9464-49c3-9372-d6c59ea59572 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054576 May 24 10:20:08.685852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 331/663] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:20:08 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:09.697010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-37454e8b-beb6-422c-a549-b25387c5984d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:09.698002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-37454e8b-beb6-422c-a549-b25387c5984d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:09.704997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37454e8b-beb6-422c-a549-b25387c5984d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:09.708472 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37454e8b-beb6-422c-a549-b25387c5984d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:09.708472 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37454e8b-beb6-422c-a549-b25387c5984d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:09.708472 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37454e8b-beb6-422c-a549-b25387c5984d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:09.736337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-37454e8b-beb6-422c-a549-b25387c5984d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043705 May 24 10:20:09.737398 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 333/664] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:20:09 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:20:09.794951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:09.796030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:09.802593 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:09.803044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:09.803862 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:09.804270 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:09.830174 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:20:10.113407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1fc32751-8965-4e4e-9554-9c52c36bef47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 204 len: 0 microversion: 2.1 time: 0.321928 May 24 10:20:10.114615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 332/665] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:20:09 2022] DELETE /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:20:10.126403 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:10.127137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:10.135269 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:10.135889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:10.136741 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:10.137247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:10.349518 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:10.360247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-57f93ec7-0a20-46a3-ad6f-f69a91f6dabb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1680 microversion: 2.1 time: 0.240856 May 24 10:20:10.361334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 334/666] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:10 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:11.378213 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:11.380217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:11.391952 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:11.392419 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:11.393199 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:11.393627 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:11.423991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:11.635199 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:11.643576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5d6f9b31-4ee5-4848-9009-40940331b10f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1680 microversion: 2.1 time: 0.269533 May 24 10:20:11.644814 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 333/667] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:11 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1680 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:12.661115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:12.661832 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:12.668420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:12.668867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:12.669941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:12.671036 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:12.767419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:12.776969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d9c70f11-9ee9-4063-99d3-bbec74c593be tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1613 microversion: 2.1 time: 0.119627 May 24 10:20:12.777804 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 335/668] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:12 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1613 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:12.996677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-b5a58201-01aa-41a3-a9b3-fe1ffef08ac0 req-67ee4a05-f8e3-4d53-877d-62d03ee183b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a59bc4-faf8-4394-9fc6-fd0acdf1215a", "name": "network-vif-deleted", "tag": "91a43870-9dca-42b2-a5c1-b943d1673abb"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:13.007440 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b5a58201-01aa-41a3-a9b3-fe1ffef08ac0 req-67ee4a05-f8e3-4d53-877d-62d03ee183b0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:13.008160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b5a58201-01aa-41a3-a9b3-fe1ffef08ac0 req-67ee4a05-f8e3-4d53-877d-62d03ee183b0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:13.019424 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-b5a58201-01aa-41a3-a9b3-fe1ffef08ac0 req-67ee4a05-f8e3-4d53-877d-62d03ee183b0 service nova] Creating event network-vif-deleted:91a43870-9dca-42b2-a5c1-b943d1673abb for instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a on hv-cinder-81045 May 24 10:20:13.024409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-b5a58201-01aa-41a3-a9b3-fe1ffef08ac0 req-67ee4a05-f8e3-4d53-877d-62d03ee183b0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032420 May 24 10:20:13.025053 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 334/669] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:20:13.796555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:13.797239 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:13.805136 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:13.805581 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:13.806353 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:13.806839 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:13.845553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:13.845779 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:13.846307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lazy-loading 'fault' on Instance uuid a9a59bc4-faf8-4394-9fc6-fd0acdf1215a {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:20:13.892348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:13.900437 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2a8b00da-4a2d-4d63-9bb4-ad16e3b1fb47 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 200 len: 1330 microversion: 2.1 time: 0.108547 May 24 10:20:13.901012 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 336/670] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:13 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:14.923447 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:14.924159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:14.930218 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:14.930667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:14.931422 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:14.931878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:14.944783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a HTTP/1.1 May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:20:14.946371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:20:14.947936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': 'a9a59bc4-faf8-4394-9fc6-fd0acdf1215a'} May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:20:14.948782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:20:14.949972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:20:14.951085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:20:14.951085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3c98a918-53dd-4f9c-8758-1abf49c620b2 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 404 len: 111 microversion: 2.1 time: 0.029138 May 24 10:20:14.951085 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 335/671] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:14 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:20:14.957195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fa8cca7f-2731-47a0-881c-d704d227a263 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '.version_select at 0x7ff63ae8faf0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:15.044030 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fa8cca7f-2731-47a0-881c-d704d227a263 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149113745" status: 202 len: 0 microversion: 2.1 time: 0.090468 May 24 10:20:15.044653 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 337/672] 10.222.0.44 () {58 vars in 1217 bytes} [Tue May 24 10:20:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149113745 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:20:15.990641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-53910a9e-3755-421e-bcbb-c62afe4fa4a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: .version_select at 0x7ff63ae4d790>, body: {"keypair": {"name": "tempest-keypair-527346113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGs6KVmDDzLJ1RNNR9jOFSUX8JIGND3rG66JKaqS1PQ620TsZiCw1hL2DANHx45X54YSGRnr1cejsSBxE47tTxbLGBZC1U7XTutiMnFDyW/6e8LFjWHpRwutI6Szmr4zAQ=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:16.005938 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-53910a9e-3755-421e-bcbb-c62afe4fa4a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:20:16.009907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-53910a9e-3755-421e-bcbb-c62afe4fa4a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:20:16.116492 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-53910a9e-3755-421e-bcbb-c62afe4fa4a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.128889 May 24 10:20:16.117206 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 336/673] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:20:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:19.340569 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-820599285", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4b9088f5-9d8c-4699-894a-607b83cfa3db"}], "security_groups": [{"name": "tempest-securitygroup--1312804686"}], "key_name": "tempest-keypair-527346113", "user_data": "}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:19.475510 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] validate_networks() for [('4b9088f5-9d8c-4699-894a-607b83cfa3db', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:20:19.933073 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:20:19.933642 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:20:19.934441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:20:19.934846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:20:19.935254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:20:19.947326 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:19.948540 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:19.948735 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:19.949328 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:19.970558 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:20:19.975953 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Getting quotas for user 06e9e172155548289ca938421d4e32bf and project 20b9157df136454d83302d24d1768d59. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:20:19.990659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:20:19.993396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:20:20.150262 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b9a865e9-537b-4845-8feb-bb1342a89b10 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.820651 May 24 10:20:20.151396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 338/674] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:20:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:20:20.163900 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-388cc11a-5a90-42f0-86f7-86877fb0b5f0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:20.164661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-388cc11a-5a90-42f0-86f7-86877fb0b5f0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:20.261725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-388cc11a-5a90-42f0-86f7-86877fb0b5f0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:20.269560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-388cc11a-5a90-42f0-86f7-86877fb0b5f0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1240 microversion: 2.1 time: 0.111172 May 24 10:20:20.276713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 337/675] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:20 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1240 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:20.876840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a1618768-7b8b-402d-a669-4a9d7bed017d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'create', calling method: .version_select at 0x7ff63ae49e50>, body: {"keypair": {"name": "tempest-keypair-299776579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1n/RY+lmmHhPdn5M2nbRaYxeNWpWH/e8U1m9oaOWZmRDmQ5tUWNbqs9IttOrpz47nwmJ5/l1w7O7UL109VpSb453NTcGEcsR3UE0oTVdPi1C/YL3Q97q79skviB64XMg=="}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:20.890875 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-a1618768-7b8b-402d-a669-4a9d7bed017d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for project f868bceb050645bea79affcb406f94d1. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:20:20.894926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-a1618768-7b8b-402d-a669-4a9d7bed017d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for user 4985774959804070b1d86f7e47b02473 and project f868bceb050645bea79affcb406f94d1. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:20:21.004147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a1618768-7b8b-402d-a669-4a9d7bed017d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.252244 May 24 10:20:21.004758 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 339/676] 10.222.0.44 () {62 vars in 1199 bytes} [Tue May 24 10:20:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 254 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 10:20:21.290880 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:21.292131 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:21.303763 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:21.304348 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:21.305183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:21.305684 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:21.374534 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:21.400675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4988af74-0cb1-47c1-b75b-4ed58eefa8d9 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1244 microversion: 2.1 time: 0.117441 May 24 10:20:21.401742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 338/677] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:21 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:22.419771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:22.421197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:22.432788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:22.433578 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:22.434736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:22.435377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:22.531605 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:22.541988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b4b10ecf-5b03-455c-a19e-5b7540bb4e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1292 microversion: 2.1 time: 0.127116 May 24 10:20:22.543152 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 340/678] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:22 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:20:23.564715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:23.566635 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:23.574007 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:23.574725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:23.575756 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:23.576248 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:23.644164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:23.653018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-def7e6e5-f6ca-4120-9be2-3dad6a4e3dc5 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1298 microversion: 2.1 time: 0.092771 May 24 10:20:23.654880 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 339/679] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:23 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1298 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:23.820866 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1353710610", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5f19b2d-98eb-4516-aad1-c4077fe39d86"}], "security_groups": [{"name": "tempest-securitygroup--1784196994"}], "key_name": "tempest-keypair-299776579", "user_data": "}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:23.956801 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.network.neutron [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] validate_networks() for [('b5f19b2d-98eb-4516-aad1-c4077fe39d86', None, None, None, None, None)] {{(pid=118130) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:20:24.338825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Flavor limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:20:24.339286 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Image limits 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:20:24.339829 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Flavor pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:20:24.340243 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Image pref 0:0:0 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:20:24.340659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.virt.hardware [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118130) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:20:24.350368 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:24.350902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:24.351769 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:24.352296 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:24.369301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for project f868bceb050645bea79affcb406f94d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:20:24.372986 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for user 4985774959804070b1d86f7e47b02473 and project f868bceb050645bea79affcb406f94d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:20:24.383781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Going to run 1 instances... {{(pid=118130) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:20:24.385981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118130) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:20:24.499708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-409e677f-27c2-46a7-9785-765be22466e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.683808 May 24 10:20:24.510712 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-260ae8f8-664d-462c-8f86-cd33bac98a53 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:24.511400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-260ae8f8-664d-462c-8f86-cd33bac98a53 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:24.513486 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 341/680] 10.222.0.44 () {62 vars in 1187 bytes} [Tue May 24 10:20:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 10:20:24.627834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-260ae8f8-664d-462c-8f86-cd33bac98a53 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:24.636522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-260ae8f8-664d-462c-8f86-cd33bac98a53 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:24.637923 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-260ae8f8-664d-462c-8f86-cd33bac98a53 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:24.639202 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-260ae8f8-664d-462c-8f86-cd33bac98a53 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1281 microversion: 2.20 time: 0.132775 May 24 10:20:24.649784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 340/681] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:24 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1281 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:24.678586 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:24.682653 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:24.691858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:24.692275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:24.696468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:24.696468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:24.868006 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:24.876532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3d5a6fd2-217e-467d-9de7-dcc87a0cbbdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.203060 May 24 10:20:24.877114 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 342/682] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:24 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:24.905030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-1699088a-4ee1-4d0c-872c-9f42cf857d31 req-e2f9db7c-0a29-435c-9a0f-02d673d14fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bf57e3-86a6-4440-9210-a889d5b1adaf", "tag": "dccc4943-96f4-4376-ac15-8ded589eca1e"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:24.923148 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1699088a-4ee1-4d0c-872c-9f42cf857d31 req-e2f9db7c-0a29-435c-9a0f-02d673d14fd1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:24.923148 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1699088a-4ee1-4d0c-872c-9f42cf857d31 req-e2f9db7c-0a29-435c-9a0f-02d673d14fd1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:24.927150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-1699088a-4ee1-4d0c-872c-9f42cf857d31 req-e2f9db7c-0a29-435c-9a0f-02d673d14fd1 service nova] Creating event network-changed:dccc4943-96f4-4376-ac15-8ded589eca1e for instance 71bf57e3-86a6-4440-9210-a889d5b1adaf on hv-cinder-81045 May 24 10:20:24.933725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-1699088a-4ee1-4d0c-872c-9f42cf857d31 req-e2f9db7c-0a29-435c-9a0f-02d673d14fd1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034152 May 24 10:20:24.934474 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 341/683] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:25.657174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:25.657809 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:25.664162 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:25.664607 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:25.665376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:25.665814 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:25.730586 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:25.739022 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:25.740568 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:25.741691 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0ba9693d-2354-424d-8423-25e6fa8ec645 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1285 microversion: 2.20 time: 0.088604 May 24 10:20:25.742248 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 343/684] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:25 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:25.894300 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:25.894901 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:25.901653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:25.902134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:25.902885 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:25.903311 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:26.035458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:26.042773 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fa375093-0981-465c-9682-31cf0f7c46fb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.152815 May 24 10:20:26.043332 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 342/685] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:25 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:26.760137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:26.760689 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:26.767280 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:26.767718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:26.768515 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:26.768953 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:26.830029 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:26.838043 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:26.839552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:26.840682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2af11473-30fd-4c5f-be7a-0dcf8c022ab6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1277 microversion: 2.20 time: 0.084600 May 24 10:20:26.841436 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 344/686] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:26 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:27.059538 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:27.060092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:27.066522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:27.066967 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:27.067745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:27.068199 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:27.177789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2e8baed9-63ba-46a5-a81d-a8429f38ef81 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:27.179060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2e8baed9-63ba-46a5-a81d-a8429f38ef81 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:27.185153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e8baed9-63ba-46a5-a81d-a8429f38ef81 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:27.185607 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e8baed9-63ba-46a5-a81d-a8429f38ef81 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:27.186556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e8baed9-63ba-46a5-a81d-a8429f38ef81 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:27.186993 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2e8baed9-63ba-46a5-a81d-a8429f38ef81 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:27.200034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:27.207940 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-802ede07-4da3-4f7b-925c-6ff5b2ffd2ee tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.152276 May 24 10:20:27.208497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 343/687] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:27 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:27.210682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2e8baed9-63ba-46a5-a81d-a8429f38ef81 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/ips" status: 200 len: 147 microversion: 2.1 time: 0.036611 May 24 10:20:27.213996 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 345/688] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:20:27 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:20:27.859146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:27.860103 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:27.866010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:27.866452 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:27.867222 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:27.867635 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:27.935458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:27.947872 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:27.949452 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:27.950572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-313f4840-2d0a-46aa-836b-70a9830095bf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1351 microversion: 2.20 time: 0.095826 May 24 10:20:27.951628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 344/689] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:27 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:28.225744 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:28.226348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:28.232928 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:28.233377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:28.234141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:28.234572 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:28.375700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:28.383551 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-12b7a608-103e-4e25-a971-3c33f118e8ba tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.161638 May 24 10:20:28.384210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 346/690] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:28 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:28.833043 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f71c7f61-7354-4505-bfdb-f3732b228c06 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8aab632e-2e18-4268-92eb-4e2ef60bdc13"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:28.834366 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f71c7f61-7354-4505-bfdb-f3732b228c06 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:28.840965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f71c7f61-7354-4505-bfdb-f3732b228c06 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:28.841421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f71c7f61-7354-4505-bfdb-f3732b228c06 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:28.842335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f71c7f61-7354-4505-bfdb-f3732b228c06 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:28.842777 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f71c7f61-7354-4505-bfdb-f3732b228c06 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:28.969819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:28.970451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:28.976614 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:28.977057 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:28.977810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:28.978234 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:29.133714 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:29.140684 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:29.142341 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:29.143593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-3d89a7ae-29b1-41a1-992b-d74cc1705c5a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.177808 May 24 10:20:29.144382 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 347/691] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:28 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:20:29.298001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-494cc7f8-740e-46e7-adf8-30affa5e35de req-ce83f2b5-3548-4fa5-8553-3a410d310f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe007745-7114-45bd-beef-67cbecf48624", "tag": "a2beb885-96ae-4021-a2ba-85363ba17a9f"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:29.307952 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-494cc7f8-740e-46e7-adf8-30affa5e35de req-ce83f2b5-3548-4fa5-8553-3a410d310f04 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:29.308400 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-494cc7f8-740e-46e7-adf8-30affa5e35de req-ce83f2b5-3548-4fa5-8553-3a410d310f04 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:29.323144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-494cc7f8-740e-46e7-adf8-30affa5e35de req-ce83f2b5-3548-4fa5-8553-3a410d310f04 service nova] Creating event network-changed:a2beb885-96ae-4021-a2ba-85363ba17a9f for instance fe007745-7114-45bd-beef-67cbecf48624 on hv-cinder-81045 May 24 10:20:29.338877 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-494cc7f8-740e-46e7-adf8-30affa5e35de req-ce83f2b5-3548-4fa5-8553-3a410d310f04 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039020 May 24 10:20:29.339984 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 348/692] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:20:29.402274 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:29.403048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:29.410339 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:29.410788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:29.411973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:29.412618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:29.575083 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:29.584420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e8251874-acaa-4a45-8f10-6ac681eda18a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.187214 May 24 10:20:29.585024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 349/693] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:29 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:20:29.709469 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f71c7f61-7354-4505-bfdb-f3732b228c06 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.879972 May 24 10:20:29.710114 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 345/694] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:20:28 2022] POST /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments => generated 194 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:30.162554 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:30.163171 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:30.169222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:30.170148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:30.170905 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:30.171326 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:30.301968 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:30.310482 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:30.312107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:30.313225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-75f94ae5-bbd3-4c11-8141-34d6b34b832b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.154652 May 24 10:20:30.313776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 350/695] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:30 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:30.602856 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:30.603544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:30.610349 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:30.610796 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:30.611554 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:30.612012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:30.741531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:30.749141 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-38f6a6bc-8aa2-442e-bb8b-6afa772733a1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.151075 May 24 10:20:30.749714 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 346/696] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:30 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:31.331061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:31.331777 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:31.338457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:31.338901 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:31.339654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:31.340102 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:31.474641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:31.481898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:31.484001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:31.485098 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4423d53e-56f4-4228-a1a1-29dca354e4cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.157917 May 24 10:20:31.485654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 351/697] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:31 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:31.629327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-b6288a93-2482-4adc-9c13-724689ffd119 req-1a0cd1e2-4f45-4c6a-bcb2-edee2ecca2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bf57e3-86a6-4440-9210-a889d5b1adaf", "name": "network-vif-plugged", "status": "completed", "tag": "dccc4943-96f4-4376-ac15-8ded589eca1e"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:31.637942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b6288a93-2482-4adc-9c13-724689ffd119 req-1a0cd1e2-4f45-4c6a-bcb2-edee2ecca2ad service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:31.638878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b6288a93-2482-4adc-9c13-724689ffd119 req-1a0cd1e2-4f45-4c6a-bcb2-edee2ecca2ad service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:31.651653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-b6288a93-2482-4adc-9c13-724689ffd119 req-1a0cd1e2-4f45-4c6a-bcb2-edee2ecca2ad service nova] Creating event network-vif-plugged:dccc4943-96f4-4376-ac15-8ded589eca1e for instance 71bf57e3-86a6-4440-9210-a889d5b1adaf on hv-cinder-81045 May 24 10:20:31.657453 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-b6288a93-2482-4adc-9c13-724689ffd119 req-1a0cd1e2-4f45-4c6a-bcb2-edee2ecca2ad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090113 May 24 10:20:31.658416 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 347/698] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:31.766303 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:31.767052 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:31.773011 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:31.773457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:31.774207 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:31.774708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:31.905547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:31.913131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ca306164-0dd5-406d-9504-5294bc1ba99e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.151308 May 24 10:20:31.913697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 352/699] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:31 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:32.503429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:32.504132 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:32.510327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:32.510805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:32.511556 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:32.512022 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:32.638553 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:32.646510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:32.648055 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:32.649192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ced9774f-c12f-4e3d-8d62-5bffae380cdf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.149945 May 24 10:20:32.649789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 348/700] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:32 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:32.930329 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:32.931049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:32.946366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:32.946936 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:32.947868 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:32.948426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:32.968273 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:33.080437 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:33.088204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1d64972b-f4d1-4b11-8c8c-a52bdb660cd0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1366 microversion: 2.1 time: 0.161647 May 24 10:20:33.088784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 353/701] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:32 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:33.667811 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:33.668420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:33.675174 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:33.675613 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:33.676389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:33.676816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:33.803086 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:33.811641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:33.813275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:33.814391 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4a929b86-76b3-409a-87ed-4e3805e958c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.150711 May 24 10:20:33.814944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 349/702] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:33 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:34.105715 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:34.106431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:34.113869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:34.114320 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:34.115080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:34.115513 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:34.243596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:34.251179 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-15bf7296-3f81-4929-b59f-8e9de8eecbc4 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1556 microversion: 2.1 time: 0.149313 May 24 10:20:34.251740 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 354/703] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:34 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:34.267301 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c61ad1a5-0145-4fd6-9b60-92ce13e14e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:34.267784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c61ad1a5-0145-4fd6-9b60-92ce13e14e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:34.273672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c61ad1a5-0145-4fd6-9b60-92ce13e14e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:34.274120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c61ad1a5-0145-4fd6-9b60-92ce13e14e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:34.274869 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c61ad1a5-0145-4fd6-9b60-92ce13e14e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:34.275292 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c61ad1a5-0145-4fd6-9b60-92ce13e14e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:34.351378 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c61ad1a5-0145-4fd6-9b60-92ce13e14e0c tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088057 May 24 10:20:34.352003 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 350/704] 10.222.0.44 () {58 vars in 1274 bytes} [Tue May 24 10:20:34 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:34.832705 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:34.833307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:34.835368 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=4 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:34.836050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=16 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:34.840880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:34.841354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:34.842118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:34.842551 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:35.089924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:35.090976 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:35.092506 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:35.093630 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5eae772a-65c8-4541-9180-23acbd14fd92 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.264771 May 24 10:20:35.094204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 355/705] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:34 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:35.542188 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=8 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:35.547018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-bf3e7df5-ff67-4b3f-817e-6f8e1e45bab2 req-ffd431c1-97f0-4a27-8a94-83c8db793b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe007745-7114-45bd-beef-67cbecf48624", "name": "network-vif-plugged", "status": "completed", "tag": "a2beb885-96ae-4021-a2ba-85363ba17a9f"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:35.551633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:35.557177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bf3e7df5-ff67-4b3f-817e-6f8e1e45bab2 req-ffd431c1-97f0-4a27-8a94-83c8db793b31 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:35.557691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bf3e7df5-ff67-4b3f-817e-6f8e1e45bab2 req-ffd431c1-97f0-4a27-8a94-83c8db793b31 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:35.571255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-bf3e7df5-ff67-4b3f-817e-6f8e1e45bab2 req-ffd431c1-97f0-4a27-8a94-83c8db793b31 service nova] Creating event network-vif-plugged:a2beb885-96ae-4021-a2ba-85363ba17a9f for instance fe007745-7114-45bd-beef-67cbecf48624 on hv-cinder-81045 May 24 10:20:35.576860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-bf3e7df5-ff67-4b3f-817e-6f8e1e45bab2 req-ffd431c1-97f0-4a27-8a94-83c8db793b31 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034742 May 24 10:20:35.577734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 351/706] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:35.630463 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-0187c079-9dbc-40c6-919d-ecad85afcb2a req-008e6f35-6dd3-4081-ba3a-a081f8624c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bf57e3-86a6-4440-9210-a889d5b1adaf", "tag": "dccc4943-96f4-4376-ac15-8ded589eca1e"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:35.636304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:35.641350 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-0187c079-9dbc-40c6-919d-ecad85afcb2a req-008e6f35-6dd3-4081-ba3a-a081f8624c22 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:35.641784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-0187c079-9dbc-40c6-919d-ecad85afcb2a req-008e6f35-6dd3-4081-ba3a-a081f8624c22 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:35.653334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-0187c079-9dbc-40c6-919d-ecad85afcb2a req-008e6f35-6dd3-4081-ba3a-a081f8624c22 service nova] Creating event network-changed:dccc4943-96f4-4376-ac15-8ded589eca1e for instance 71bf57e3-86a6-4440-9210-a889d5b1adaf on hv-cinder-81045 May 24 10:20:35.660212 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-0187c079-9dbc-40c6-919d-ecad85afcb2a req-008e6f35-6dd3-4081-ba3a-a081f8624c22 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033413 May 24 10:20:35.661309 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 356/707] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:36.112632 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:36.113316 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:36.120759 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:36.121229 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:36.121988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:36.122421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:36.251808 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:36.259641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:36.261167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:36.262276 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cbc54a3a-6227-4824-90e5-1d4bc47f1bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.153966 May 24 10:20:36.263023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 352/708] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:36 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:37.282041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:37.282837 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:37.289769 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:37.292893 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:37.292893 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:37.292893 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:37.424620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:37.433067 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:37.434835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:37.437016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2285eb98-6bec-47d8-9545-141e56bbecad tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1407 microversion: 2.20 time: 0.159826 May 24 10:20:37.437792 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 357/709] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:37 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:38.271197 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2a2e2532-4a25-4045-8fac-27869d77d435 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:38.272146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2a2e2532-4a25-4045-8fac-27869d77d435 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:38.278544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a2e2532-4a25-4045-8fac-27869d77d435 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.279023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a2e2532-4a25-4045-8fac-27869d77d435 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.279784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a2e2532-4a25-4045-8fac-27869d77d435 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.280240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2a2e2532-4a25-4045-8fac-27869d77d435 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.309094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2a2e2532-4a25-4045-8fac-27869d77d435 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041774 May 24 10:20:38.309637 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 353/710] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:20:38 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:38.319922 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-31b82932-9024-4ffa-9281-9a1a2036c915 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:38.320433 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-31b82932-9024-4ffa-9281-9a1a2036c915 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:38.326852 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31b82932-9024-4ffa-9281-9a1a2036c915 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.327297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31b82932-9024-4ffa-9281-9a1a2036c915 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.328077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31b82932-9024-4ffa-9281-9a1a2036c915 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.328509 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-31b82932-9024-4ffa-9281-9a1a2036c915 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.356740 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-31b82932-9024-4ffa-9281-9a1a2036c915 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/8aab632e-2e18-4268-92eb-4e2ef60bdc13" status: 200 len: 194 microversion: 2.1 time: 0.040673 May 24 10:20:38.357918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 358/711] 10.222.0.44 () {58 vars in 1412 bytes} [Tue May 24 10:20:38 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/8aab632e-2e18-4268-92eb-4e2ef60bdc13 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:38.454428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:38.461227 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:38.461429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.461881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.462705 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.463161 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.593420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:38.601163 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:38.602685 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:38.603847 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9aab7182-ad4d-4f2b-94a8-0c6df9c42e50 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1599 microversion: 2.20 time: 0.153358 May 24 10:20:38.604604 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 354/712] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:20:38 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:20:38.621737 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-25ec4a4e-70ff-4a54-9d3f-fe0e2e91a2c2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:38.622580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-25ec4a4e-70ff-4a54-9d3f-fe0e2e91a2c2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:38.628738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-25ec4a4e-70ff-4a54-9d3f-fe0e2e91a2c2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.629172 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-25ec4a4e-70ff-4a54-9d3f-fe0e2e91a2c2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.629938 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-25ec4a4e-70ff-4a54-9d3f-fe0e2e91a2c2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:38.630371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-25ec4a4e-70ff-4a54-9d3f-fe0e2e91a2c2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:38.708454 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-25ec4a4e-70ff-4a54-9d3f-fe0e2e91a2c2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090538 May 24 10:20:38.709306 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 359/713] 10.222.0.44 () {60 vars in 1315 bytes} [Tue May 24 10:20:38 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:20:39.675177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-044baedf-24aa-4607-aef6-4e90e57391cb req-ef65dc3c-5f4b-486b-8cbb-b8ac68deb588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe007745-7114-45bd-beef-67cbecf48624", "tag": "a2beb885-96ae-4021-a2ba-85363ba17a9f"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:39.683931 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-044baedf-24aa-4607-aef6-4e90e57391cb req-ef65dc3c-5f4b-486b-8cbb-b8ac68deb588 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:39.684442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-044baedf-24aa-4607-aef6-4e90e57391cb req-ef65dc3c-5f4b-486b-8cbb-b8ac68deb588 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:39.695596 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-044baedf-24aa-4607-aef6-4e90e57391cb req-ef65dc3c-5f4b-486b-8cbb-b8ac68deb588 service nova] Creating event network-changed:a2beb885-96ae-4021-a2ba-85363ba17a9f for instance fe007745-7114-45bd-beef-67cbecf48624 on hv-cinder-81045 May 24 10:20:39.701034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-044baedf-24aa-4607-aef6-4e90e57391cb req-ef65dc3c-5f4b-486b-8cbb-b8ac68deb588 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029129 May 24 10:20:39.702018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 355/714] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:20:39.930998 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-10914cf8-6a59-4545-b061-565ecb1e2ff9 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7f6f390-2ad8-426c-ba7d-f13057cb6ef7"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:39.932224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-10914cf8-6a59-4545-b061-565ecb1e2ff9 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:39.938516 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10914cf8-6a59-4545-b061-565ecb1e2ff9 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:39.939075 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10914cf8-6a59-4545-b061-565ecb1e2ff9 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:39.940094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10914cf8-6a59-4545-b061-565ecb1e2ff9 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:39.940596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10914cf8-6a59-4545-b061-565ecb1e2ff9 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:40.694446 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-10914cf8-6a59-4545-b061-565ecb1e2ff9 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "POST /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767535 May 24 10:20:40.694995 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 360/715] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:20:39 2022] POST /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:48.186458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fe42c79b-7916-4029-83c2-77f3bb8fdba5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:48.187473 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fe42c79b-7916-4029-83c2-77f3bb8fdba5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:48.193586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe42c79b-7916-4029-83c2-77f3bb8fdba5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:48.194034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe42c79b-7916-4029-83c2-77f3bb8fdba5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:48.194788 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe42c79b-7916-4029-83c2-77f3bb8fdba5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:48.195220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fe42c79b-7916-4029-83c2-77f3bb8fdba5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:48.197670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:20:48.226674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fe42c79b-7916-4029-83c2-77f3bb8fdba5 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045284 May 24 10:20:48.227223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 356/716] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:20:48 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:48.368003 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4ad55007-61b3-4829-b018-2d2481fbfb6c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:48.368594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4ad55007-61b3-4829-b018-2d2481fbfb6c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:48.375403 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ad55007-61b3-4829-b018-2d2481fbfb6c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:48.375866 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ad55007-61b3-4829-b018-2d2481fbfb6c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:48.376621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ad55007-61b3-4829-b018-2d2481fbfb6c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:48.377048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4ad55007-61b3-4829-b018-2d2481fbfb6c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:48.405408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4ad55007-61b3-4829-b018-2d2481fbfb6c tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/8aab632e-2e18-4268-92eb-4e2ef60bdc13" status: 200 len: 194 microversion: 2.1 time: 0.042690 May 24 10:20:48.405986 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 361/717] 10.222.0.44 () {58 vars in 1412 bytes} [Tue May 24 10:20:48 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/8aab632e-2e18-4268-92eb-4e2ef60bdc13 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:48.415510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:48.415985 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:48.422753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:48.423200 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:48.424559 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:48.424559 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:48.505063 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lazy-loading 'services' on Instance uuid 6d13e704-de25-497a-b01b-585c5b4207aa {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:20:48.718284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f41262e7-5d73-4ec7-a72d-46f8c21db5ac tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/8aab632e-2e18-4268-92eb-4e2ef60bdc13" status: 202 len: 0 microversion: 2.1 time: 0.306454 May 24 10:20:48.718832 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 357/718] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:20:48 2022] DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/8aab632e-2e18-4268-92eb-4e2ef60bdc13 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:20:50.881328 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6ac4ba2f-0cef-4b31-92e2-02e12ed8df77 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:50.881825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6ac4ba2f-0cef-4b31-92e2-02e12ed8df77 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:50.888878 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6ac4ba2f-0cef-4b31-92e2-02e12ed8df77 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:50.889326 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6ac4ba2f-0cef-4b31-92e2-02e12ed8df77 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:50.890086 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6ac4ba2f-0cef-4b31-92e2-02e12ed8df77 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:50.890521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6ac4ba2f-0cef-4b31-92e2-02e12ed8df77 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:50.917683 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6ac4ba2f-0cef-4b31-92e2-02e12ed8df77 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/c7f6f390-2ad8-426c-ba7d-f13057cb6ef7" status: 200 len: 194 microversion: 2.1 time: 0.040277 May 24 10:20:50.918255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 362/719] 10.222.0.44 () {58 vars in 1412 bytes} [Tue May 24 10:20:50 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/c7f6f390-2ad8-426c-ba7d-f13057cb6ef7 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:20:50.929453 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:50.930027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:50.936717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:50.937158 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:50.937910 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:50.938338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:51.018267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lazy-loading 'services' on Instance uuid 6d13e704-de25-497a-b01b-585c5b4207aa {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:20:51.197089 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c19bc11a-c7ee-4763-859a-ef03f7053a5f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/c7f6f390-2ad8-426c-ba7d-f13057cb6ef7" status: 202 len: 0 microversion: 2.1 time: 0.272091 May 24 10:20:51.197682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 358/720] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:20:50 2022] DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments/c7f6f390-2ad8-426c-ba7d-f13057cb6ef7 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:20:52.358005 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d1763a2a-d9c0-498d-9c16-40ade9dcd8e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:52.359056 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d1763a2a-d9c0-498d-9c16-40ade9dcd8e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:52.366863 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1763a2a-d9c0-498d-9c16-40ade9dcd8e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.367336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1763a2a-d9c0-498d-9c16-40ade9dcd8e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:52.368149 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1763a2a-d9c0-498d-9c16-40ade9dcd8e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.368590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d1763a2a-d9c0-498d-9c16-40ade9dcd8e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:52.399855 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d1763a2a-d9c0-498d-9c16-40ade9dcd8e4 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047694 May 24 10:20:52.400417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 363/721] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:20:52 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:20:52.510165 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-87f4aa1e-715f-439a-a893-eb03fcc67330 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:52.511217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-87f4aa1e-715f-439a-a893-eb03fcc67330 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:52.518002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87f4aa1e-715f-439a-a893-eb03fcc67330 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.518448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87f4aa1e-715f-439a-a893-eb03fcc67330 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:52.519210 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87f4aa1e-715f-439a-a893-eb03fcc67330 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.519641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-87f4aa1e-715f-439a-a893-eb03fcc67330 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:52.547606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-87f4aa1e-715f-439a-a893-eb03fcc67330 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042130 May 24 10:20:52.548181 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 359/722] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:20:52 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:20:52.606746 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:52.607238 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:52.613235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.613683 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:52.614448 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.614883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:52.640567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:20:52.922143 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5cb542b0-6bb3-4407-9a7f-6c30dc82f18b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 204 len: 0 microversion: 2.1 time: 0.318957 May 24 10:20:52.922736 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 364/723] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:20:52 2022] DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:20:52.930786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:52.931390 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:52.937877 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.938323 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:52.939082 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:52.939514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:53.069152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:53.077169 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-efc1270f-893d-429a-bb44-663e948c7faf tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1676 microversion: 2.1 time: 0.150171 May 24 10:20:53.077759 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 360/724] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:52 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:54.095540 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:54.096264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:54.102654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:54.103103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:54.103883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:54.104317 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:54.229199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:54.237313 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-712366d2-2913-417a-b30d-133b56517104 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1676 microversion: 2.1 time: 0.146536 May 24 10:20:54.237872 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 365/725] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:54 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:55.254667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:55.255260 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:55.261948 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:55.262395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:55.263739 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:55.264357 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:55.400713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:55.410058 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e0c55b12-a563-4e8f-b6bb-fa3421308064 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1676 microversion: 2.1 time: 0.158989 May 24 10:20:55.411060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 361/726] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:55 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:56.098327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-513e32b8-3411-4ce8-9ea0-426cdfecc1d5 req-3fc24ffb-2890-48f5-87e4-2fa0e4f866ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d13e704-de25-497a-b01b-585c5b4207aa", "name": "network-vif-deleted", "tag": "e078a98e-6d66-4de7-bd2d-157212764871"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:20:56.101351 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-513e32b8-3411-4ce8-9ea0-426cdfecc1d5 req-3fc24ffb-2890-48f5-87e4-2fa0e4f866ef service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:56.101796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-513e32b8-3411-4ce8-9ea0-426cdfecc1d5 req-3fc24ffb-2890-48f5-87e4-2fa0e4f866ef service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:56.112980 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-513e32b8-3411-4ce8-9ea0-426cdfecc1d5 req-3fc24ffb-2890-48f5-87e4-2fa0e4f866ef service nova] Creating event network-vif-deleted:e078a98e-6d66-4de7-bd2d-157212764871 for instance 6d13e704-de25-497a-b01b-585c5b4207aa on hv-cinder-81045 May 24 10:20:56.118046 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-513e32b8-3411-4ce8-9ea0-426cdfecc1d5 req-3fc24ffb-2890-48f5-87e4-2fa0e4f866ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029110 May 24 10:20:56.118630 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 366/727] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:20:56.429865 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:56.430814 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:56.441030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:56.441814 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:56.443362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:56.444367 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:56.487493 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:56.487972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:56.488416 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lazy-loading 'fault' on Instance uuid 6d13e704-de25-497a-b01b-585c5b4207aa {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:20:56.530456 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec86bb8790745aaaa45b6d9e4d94ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec0a495fa51c4f038a6d18b3185bcbb0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:20:56.539044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-99b995f0-90c4-4fa9-bf9a-fe7b323cab17 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 200 len: 1328 microversion: 2.1 time: 0.114354 May 24 10:20:56.542269 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 362/728] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:56 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:20:57.557342 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:57.558064 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:20:57.564335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:57.569954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:57.569954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:20:57.569954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:20:57.578914 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] HTTP exception thrown: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Request method failure captured: May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa HTTP/1.1 May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAJtoKVxNt5Y5R5lDaAs97xn-oQ65xrtxIw8AKBaV_gaszHfuNV9wojURWZoZLE9oqTMmb0Ims5SjrQecms4lIIaxlOJaohEPb1RAHCIR5RGBqLnb2l4e52Usj77JnOjn4WCxZ6mhx2pQ24wJnqFrkVTUrS2UQIua86D90Bjdo0pQA May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:20:57.580525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec0a495fa51c4f038a6d18b3185bcbb0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeTestJSON-1808574469 May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: eec86bb8790745aaaa45b6d9e4d94ca7 May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:20:57.582254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '6d13e704-de25-497a-b01b-585c5b4207aa'} May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:20:57.583195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:20:57.585025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:20:57.586698 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Returning 404 to user: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:20:57.586698 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6dad639c-ef9b-4475-aa5e-782129e23a70 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 404 len: 111 microversion: 2.1 time: 0.029297 May 24 10:20:57.586698 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 367/729] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:20:57 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:20:57.593081 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cc904ba2-75c8-469a-b01e-db2e9da29d9b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '.version_select at 0x7ff63aebd3a0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:20:57.688633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cc904ba2-75c8-469a-b01e-db2e9da29d9b tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883898905" status: 202 len: 0 microversion: 2.1 time: 0.101239 May 24 10:20:57.689204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 363/730] 10.222.0.44 () {58 vars in 1220 bytes} [Tue May 24 10:20:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883898905 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:21:01.007577 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:01.008175 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:01.015254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:01.015699 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:01.016579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:01.017010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:01.030110 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] HTTP exception thrown: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Request method failure captured: May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa HTTP/1.1 May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAJtoKVxNt5Y5R5lDaAs97xn-oQ65xrtxIw8AKBaV_gaszHfuNV9wojURWZoZLE9oqTMmb0Ims5SjrQecms4lIIaxlOJaohEPb1RAHCIR5RGBqLnb2l4e52Usj77JnOjn4WCxZ6mhx2pQ24wJnqFrkVTUrS2UQIua86D90Bjdo0pQA May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:01.032340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec0a495fa51c4f038a6d18b3185bcbb0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: eec86bb8790745aaaa45b6d9e4d94ca7 May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.034093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '6d13e704-de25-497a-b01b-585c5b4207aa'} May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:01.034898 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.036223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:01.037482 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Returning 404 to user: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:01.037482 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ad99d793-74f0-4052-9d2d-9aaa344f07a0 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 404 len: 111 microversion: 2.1 time: 0.029973 May 24 10:21:01.037482 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 368/731] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:21:01 2022] DELETE /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:01.042183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:01.042786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: 6d13e704-de25-497a-b01b-585c5b4207aa] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:01.050037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:01.050477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:01.051234 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:01.051663 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:01.064816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] HTTP exception thrown: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Request method failure captured: May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa HTTP/1.1 May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAJtoKVxNt5Y5R5lDaAs97xn-oQ65xrtxIw8AKBaV_gaszHfuNV9wojURWZoZLE9oqTMmb0Ims5SjrQecms4lIIaxlOJaohEPb1RAHCIR5RGBqLnb2l4e52Usj77JnOjn4WCxZ6mhx2pQ24wJnqFrkVTUrS2UQIua86D90Bjdo0pQA May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:01.066423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec0a495fa51c4f038a6d18b3185bcbb0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: eec86bb8790745aaaa45b6d9e4d94ca7 May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.068060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '6d13e704-de25-497a-b01b-585c5b4207aa'} May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:01.069204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. May 24 10:21:01.070722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:01.072253 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Returning 404 to user: Instance 6d13e704-de25-497a-b01b-585c5b4207aa could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:01.072253 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e9191316-0e88-4f7b-a9be-7737460dc11f tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa" status: 404 len: 111 microversion: 2.1 time: 0.029639 May 24 10:21:01.072253 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 364/732] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:01 2022] GET /compute/v2.1/servers/6d13e704-de25-497a-b01b-585c5b4207aa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:02.358755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:02.359298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:02.366660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:02.367137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:02.367989 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:02.368486 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:02.382933 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] HTTP exception thrown: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Request method failure captured: May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 HTTP/1.1 May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAJtoKVxNt5Y5R5lDaAs97xn-oQ65xrtxIw8AKBaV_gaszHfuNV9wojURWZoZLE9oqTMmb0Ims5SjrQecms4lIIaxlOJaohEPb1RAHCIR5RGBqLnb2l4e52Usj77JnOjn4WCxZ6mhx2pQ24wJnqFrkVTUrS2UQIua86D90Bjdo0pQA May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:02.384609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec0a495fa51c4f038a6d18b3185bcbb0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: eec86bb8790745aaaa45b6d9e4d94ca7 May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.386194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'c8b45da9-b689-4ab8-aa70-2b00c4b687f5'} May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:02.387318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.388911 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:02.391366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Returning 404 to user: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:02.391366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a2ac6728-d5dc-470f-9950-13a8b48e1f46 tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 404 len: 111 microversion: 2.1 time: 0.032020 May 24 10:21:02.391366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 369/733] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:21:02 2022] DELETE /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:02.395593 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:02.396270 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] [instance: c8b45da9-b689-4ab8-aa70-2b00c4b687f5] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:02.403115 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:02.403581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:02.404470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:02.404932 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:02.419581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] HTTP exception thrown: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Request method failure captured: May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 HTTP/1.1 May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAJtoKVxNt5Y5R5lDaAs97xn-oQ65xrtxIw8AKBaV_gaszHfuNV9wojURWZoZLE9oqTMmb0Ims5SjrQecms4lIIaxlOJaohEPb1RAHCIR5RGBqLnb2l4e52Usj77JnOjn4WCxZ6mhx2pQ24wJnqFrkVTUrS2UQIua86D90Bjdo0pQA May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:02.421289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ec0a495fa51c4f038a6d18b3185bcbb0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ec0a495fa51c4f038a6d18b3185bcbb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: ec0a495fa51c4f038a6d18b3185bcbb0 May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1808574469 May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: eec86bb8790745aaaa45b6d9e4d94ca7 May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeTestJSON-1808574469-project May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.422879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': 'c8b45da9-b689-4ab8-aa70-2b00c4b687f5'} May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:02.423749 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. May 24 10:21:02.425236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:02.426606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] Returning 404 to user: Instance c8b45da9-b689-4ab8-aa70-2b00c4b687f5 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:02.426606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-75016503-9621-4c59-83a6-d149ee2a877e tempest-AttachVolumeTestJSON-1808574469 tempest-AttachVolumeTestJSON-1808574469-project] 10.222.0.44 "GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5" status: 404 len: 111 microversion: 2.1 time: 0.031319 May 24 10:21:02.426606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 365/734] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:02 2022] GET /compute/v2.1/servers/c8b45da9-b689-4ab8-aa70-2b00c4b687f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:07.866826 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c74c3c9d-db8a-41c8-aa8a-a5151fd15b55 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Action: 'create', calling method: .version_select at 0x7ff63affc4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-868302750"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:08.455579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c74c3c9d-db8a-41c8-aa8a-a5151fd15b55 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.700311 May 24 10:21:08.456243 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 370/735] 10.222.0.44 () {60 vars in 1154 bytes} [Tue May 24 10:21:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 702 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 24 10:21:08.467417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a86f23ab-1d4b-4ca4-8b3b-7d5382f68354 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63aebba60>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:08.518162 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a86f23ab-1d4b-4ca4-8b3b-7d5382f68354 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511" status: 200 len: 344 microversion: 2.1 time: 0.054469 May 24 10:21:08.518812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 366/736] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:21:08 2022] GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:09.531107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9304de08-5b51-4998-b914-ba5dfaabbcf1 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae45d30>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:09.577666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9304de08-5b51-4998-b914-ba5dfaabbcf1 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511" status: 200 len: 345 microversion: 2.1 time: 0.050903 May 24 10:21:09.578231 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 371/737] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:21:09 2022] GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:09.589721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-97c40fea-db60-4062-8589-d78c8142f323 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Action: 'create', calling method: .version_select at 0x7ff63ae03430>, body: {"snapshot": {"volume_id": "03ec255b-a181-44d1-ae07-8437e1424511", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1014982620"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:10.055142 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-97c40fea-db60-4062-8589-d78c8142f323 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.469555 May 24 10:21:10.060233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 367/738] 10.222.0.44 () {60 vars in 1161 bytes} [Tue May 24 10:21:09 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:10.066246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fb1d503a-4b29-44b7-b859-af6b12f8963a tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae180d0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:10.096182 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fb1d503a-4b29-44b7-b859-af6b12f8963a tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 200 len: 287 microversion: 2.1 time: 0.034052 May 24 10:21:10.096833 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 372/739] 10.222.0.44 () {58 vars in 1250 bytes} [Tue May 24 10:21:10 2022] GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:10.106521 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0ada0301-cbb6-492d-82ee-fcb34e7529da tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63aebbca0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:10.135738 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0ada0301-cbb6-492d-82ee-fcb34e7529da tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.032947 May 24 10:21:10.136338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 368/740] 10.222.0.44 () {58 vars in 1139 bytes} [Tue May 24 10:21:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:10.147266 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4f215238-1c8e-456b-a589-a059abc0d0ea tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae18c10>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:10.176517 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4f215238-1c8e-456b-a589-a059abc0d0ea tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 200 len: 287 microversion: 2.1 time: 0.032917 May 24 10:21:10.177072 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 373/741] 10.222.0.44 () {58 vars in 1250 bytes} [Tue May 24 10:21:10 2022] GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:11.187754 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-70485db7-9f3b-46db-bf4a-9296ac6306e8 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae4d790>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:11.217908 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-70485db7-9f3b-46db-bf4a-9296ac6306e8 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 200 len: 287 microversion: 2.1 time: 0.034477 May 24 10:21:11.218473 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 369/742] 10.222.0.44 () {58 vars in 1250 bytes} [Tue May 24 10:21:11 2022] GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:11.569126 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ebe9cf8a-b334-498d-8176-977e8c8e03b1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:11.569661 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ebe9cf8a-b334-498d-8176-977e8c8e03b1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:11.571561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:11.576871 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebe9cf8a-b334-498d-8176-977e8c8e03b1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:11.581358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebe9cf8a-b334-498d-8176-977e8c8e03b1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:11.581358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebe9cf8a-b334-498d-8176-977e8c8e03b1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:11.581358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ebe9cf8a-b334-498d-8176-977e8c8e03b1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:11.582238 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:11.602169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ebe9cf8a-b334-498d-8176-977e8c8e03b1 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/ips" status: 200 len: 150 microversion: 2.1 time: 0.037578 May 24 10:21:11.602732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 374/743] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:21:11 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:12.229989 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-af2cdbd1-377b-4131-bbed-ba321d78e78a tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae03ee0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:12.260413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-af2cdbd1-377b-4131-bbed-ba321d78e78a tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 200 len: 287 microversion: 2.1 time: 0.034625 May 24 10:21:12.260968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 370/744] 10.222.0.44 () {58 vars in 1250 bytes} [Tue May 24 10:21:12 2022] GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:13.272537 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0586bf6e-8089-46f4-a98d-43b22f62956c tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae8faf0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:13.302742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0586bf6e-8089-46f4-a98d-43b22f62956c tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 200 len: 288 microversion: 2.1 time: 0.034579 May 24 10:21:13.303297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 375/745] 10.222.0.44 () {58 vars in 1250 bytes} [Tue May 24 10:21:13 2022] GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:13.310350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:13.311112 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:13.315406 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-de0aa54d-66f1-41d8-8c09-b7c823054bca tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63aebda60>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:13.461774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-de0aa54d-66f1-41d8-8c09-b7c823054bca tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 202 len: 0 microversion: 2.1 time: 0.150894 May 24 10:21:13.461774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 371/746] 10.222.0.44 () {58 vars in 1253 bytes} [Tue May 24 10:21:13 2022] DELETE /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:21:13.469603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2976014e-8f0a-42da-a79f-5acacaf48afb tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae18ca0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:13.498962 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2976014e-8f0a-42da-a79f-5acacaf48afb tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 200 len: 287 microversion: 2.1 time: 0.033191 May 24 10:21:13.499529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 376/747] 10.222.0.44 () {58 vars in 1250 bytes} [Tue May 24 10:21:13 2022] GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:21:14.245745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ac21008d-d24d-4ea0-950a-98d2d62b5319 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cab67231-cd91-4a52-99bc-6db853fa1bdb"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:14.246793 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ac21008d-d24d-4ea0-950a-98d2d62b5319 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:14.255375 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac21008d-d24d-4ea0-950a-98d2d62b5319 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:14.255841 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac21008d-d24d-4ea0-950a-98d2d62b5319 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:14.256638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac21008d-d24d-4ea0-950a-98d2d62b5319 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:14.257099 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ac21008d-d24d-4ea0-950a-98d2d62b5319 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:14.512038 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d18ade9f-41af-4114-a411-c1b1322f0531 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63adc8ca0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:14.537190 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-d18ade9f-41af-4114-a411-c1b1322f0531 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] HTTP exception thrown: Snapshot 084a6f95-e6bc-4da1-8e68-0810db047033 could not be found. May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d18ade9f-41af-4114-a411-c1b1322f0531 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Request method failure captured: May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 HTTP/1.1 May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLGTpSIgWqpaxTH9HevuYu-l39qRIQdzFuJZgsLjtEbJ883q9eDKdH4Ee1AyyE4FgWEPmTPKtlxc5KpuF8m8-HBNukVXNtBn_r3ThX03zQuFLDSc5H-pC5eBHJJCBrl9MJmL7viGKzdWmBgdOBS6mHteVZAWIMT_VoPX9h3NY8gi-ss May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:14.539414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1371132d23044b0aa07e9f976f666ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 31a47c557bfc4cbe8e25835772bf65c5 May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Snapshot 084a6f95-e6bc-4da1-8e68-0810db047033 could not be found. May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '084a6f95-e6bc-4da1-8e68-0810db047033'} May 24 10:21:14.541208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 084a6f95-e6bc-4da1-8e68-0810db047033 could not be found. (HTTP 404) (Request-ID: req-0dc86902-bf67-4567-8e78-816c37d6da2e) May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:14.542229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:21:14.544035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 084a6f95-e6bc-4da1-8e68-0810db047033 could not be found. May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 24 10:21:14.545620 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 084a6f95-e6bc-4da1-8e68-0810db047033 could not be found. May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 084a6f95-e6bc-4da1-8e68-0810db047033 could not be found. May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d18ade9f-41af-4114-a411-c1b1322f0531 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Returning 404 to user: Snapshot 084a6f95-e6bc-4da1-8e68-0810db047033 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:14.547531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d18ade9f-41af-4114-a411-c1b1322f0531 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033" status: 404 len: 111 microversion: 2.1 time: 0.034214 May 24 10:21:14.548825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 377/748] 10.222.0.44 () {58 vars in 1250 bytes} [Tue May 24 10:21:14 2022] GET /compute/v2.1/os-snapshots/084a6f95-e6bc-4da1-8e68-0810db047033 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 24 10:21:14.549982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-99a4cf00-f549-4bce-b998-5d9a398c6043 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae18d30>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:14.761855 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-99a4cf00-f549-4bce-b998-5d9a398c6043 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511" status: 202 len: 0 microversion: 2.1 time: 0.216063 May 24 10:21:14.767436 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 378/749] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:21:14 2022] DELETE /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:21:14.771309 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-77962557-d072-4cd7-a024-48055df8b1de tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63ae3f820>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:14.819654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-77962557-d072-4cd7-a024-48055df8b1de tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511" status: 200 len: 344 microversion: 2.1 time: 0.052967 May 24 10:21:14.820240 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 379/750] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:21:14 2022] GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:21:14.977711 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ac21008d-d24d-4ea0-950a-98d2d62b5319 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "POST /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735687 May 24 10:21:14.978326 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 372/751] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:21:14 2022] POST /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:15.722435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d004aa8b-24bc-42ee-be07-8921b32de222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:15.722972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d004aa8b-24bc-42ee-be07-8921b32de222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:15.729363 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d004aa8b-24bc-42ee-be07-8921b32de222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:15.735319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d004aa8b-24bc-42ee-be07-8921b32de222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:15.735319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d004aa8b-24bc-42ee-be07-8921b32de222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:15.735319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d004aa8b-24bc-42ee-be07-8921b32de222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:15.756141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d004aa8b-24bc-42ee-be07-8921b32de222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/ips" status: 200 len: 151 microversion: 2.20 time: 0.038351 May 24 10:21:15.756688 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 380/752] 10.222.0.44 () {60 vars in 1288 bytes} [Tue May 24 10:21:15 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:21:15.832915 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b1fae0db-173f-49ec-8d08-e7b25a08891b tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63adff700>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:15.918941 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-b1fae0db-173f-49ec-8d08-e7b25a08891b tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] HTTP exception thrown: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b1fae0db-173f-49ec-8d08-e7b25a08891b tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Request method failure captured: May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 HTTP/1.1 May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLGTpSIgWqpaxTH9HevuYu-l39qRIQdzFuJZgsLjtEbJ883q9eDKdH4Ee1AyyE4FgWEPmTPKtlxc5KpuF8m8-HBNukVXNtBn_r3ThX03zQuFLDSc5H-pC5eBHJJCBrl9MJmL7viGKzdWmBgdOBS6mHteVZAWIMT_VoPX9h3NY8gi-ss May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:15.921192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1371132d23044b0aa07e9f976f666ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 31a47c557bfc4cbe8e25835772bf65c5 May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '03ec255b-a181-44d1-ae07-8437e1424511'} May 24 10:21:15.926522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. (HTTP 404) (Request-ID: req-32c897be-cc1a-47da-a5b1-6105edd7b8b1) May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:15.927404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:21:15.928694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 10:21:15.929887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b1fae0db-173f-49ec-8d08-e7b25a08891b tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Returning 404 to user: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b1fae0db-173f-49ec-8d08-e7b25a08891b tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511" status: 404 len: 109 microversion: 2.1 time: 0.095015 May 24 10:21:15.931214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 373/753] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:21:15 2022] GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:15.937510 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cd5d169b-7226-40a1-9a93-fb09263e5b78 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63adc8940>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:15.965483 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-cd5d169b-7226-40a1-9a93-fb09263e5b78 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] HTTP exception thrown: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cd5d169b-7226-40a1-9a93-fb09263e5b78 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Request method failure captured: May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 HTTP/1.1 May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLGTpSIgWqpaxTH9HevuYu-l39qRIQdzFuJZgsLjtEbJ883q9eDKdH4Ee1AyyE4FgWEPmTPKtlxc5KpuF8m8-HBNukVXNtBn_r3ThX03zQuFLDSc5H-pC5eBHJJCBrl9MJmL7viGKzdWmBgdOBS6mHteVZAWIMT_VoPX9h3NY8gi-ss May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:15.967426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1371132d23044b0aa07e9f976f666ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 31a47c557bfc4cbe8e25835772bf65c5 May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '03ec255b-a181-44d1-ae07-8437e1424511'} May 24 10:21:15.969070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. (HTTP 404) (Request-ID: req-43d7b727-c7e3-4019-92c4-8e0fe8c8e4d4) May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:15.978386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 24 10:21:15.979830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 24 10:21:15.981197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cd5d169b-7226-40a1-9a93-fb09263e5b78 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Returning 404 to user: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cd5d169b-7226-40a1-9a93-fb09263e5b78 tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511" status: 404 len: 109 microversion: 2.1 time: 0.035196 May 24 10:21:15.982539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 381/754] 10.222.0.44 () {58 vars in 1247 bytes} [Tue May 24 10:21:15 2022] DELETE /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:15.983565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b8699dc-435e-452f-8c15-4f6a73d4088d tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Calling method '.version_select at 0x7ff63adff040>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:16.009146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-4b8699dc-435e-452f-8c15-4f6a73d4088d tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] HTTP exception thrown: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b8699dc-435e-452f-8c15-4f6a73d4088d tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Request method failure captured: May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 HTTP/1.1 May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLGTpSIgWqpaxTH9HevuYu-l39qRIQdzFuJZgsLjtEbJ883q9eDKdH4Ee1AyyE4FgWEPmTPKtlxc5KpuF8m8-HBNukVXNtBn_r3ThX03zQuFLDSc5H-pC5eBHJJCBrl9MJmL7viGKzdWmBgdOBS6mHteVZAWIMT_VoPX9h3NY8gi-ss May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:16.011216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b1371132d23044b0aa07e9f976f666ec", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b1371132d23044b0aa07e9f976f666ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: b1371132d23044b0aa07e9f976f666ec May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1122224262 May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 31a47c557bfc4cbe8e25835772bf65c5 May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1122224262-project May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '03ec255b-a181-44d1-ae07-8437e1424511'} May 24 10:21:16.012894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. (HTTP 404) (Request-ID: req-9804e2d3-e9ce-4cbe-824a-02df1f0f3f12) May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:16.013801 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi item = cinderclient( May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 24 10:21:16.015307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 24 10:21:16.016806 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b8699dc-435e-452f-8c15-4f6a73d4088d tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] Returning 404 to user: Volume 03ec255b-a181-44d1-ae07-8437e1424511 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4b8699dc-435e-452f-8c15-4f6a73d4088d tempest-VolumesSnapshotsTestJSON-1122224262 tempest-VolumesSnapshotsTestJSON-1122224262-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511" status: 404 len: 109 microversion: 2.1 time: 0.038037 May 24 10:21:16.018233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 374/755] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:21:15 2022] GET /compute/v2.1/os-volumes/03ec255b-a181-44d1-ae07-8437e1424511 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:18.080460 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:18.080988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:18.088047 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:18.088494 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:18.089253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:18.089687 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:18.112016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lazy-loading 'flavor' on Instance uuid fe007745-7114-45bd-beef-67cbecf48624 {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:21:18.743421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6e7cc645-c1a7-4f59-b757-c2e7930cc9a5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/action" status: 202 len: 0 microversion: 2.20 time: 0.667429 May 24 10:21:18.745396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 382/756] 10.222.0.44 () {62 vars in 1318 bytes} [Tue May 24 10:21:18 2022] POST /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:21:18.758635 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:18.761235 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:18.772788 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:18.774643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:18.780668 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:18.781115 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:19.010370 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:19.018676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:19.021000 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:19.022188 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6872509a-0001-4d19-85a0-cd745fd2a6a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.273347 May 24 10:21:19.022753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 375/757] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:18 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:20.042304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:20.042985 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:20.052131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:20.052592 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:20.053370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:20.053803 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:20.187587 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:20.196264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:20.197753 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:20.198947 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-dc29f486-bfaf-43c4-b295-a947d9b8d724 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.161426 May 24 10:21:20.199487 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 383/758] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:20 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:21.217059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:21.217654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:21.224945 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:21.225386 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:21.226138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:21.226563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:21.360130 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:21.369275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:21.370816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:21.372026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-015be821-48f4-4671-a0d8-e6994bb44239 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.158818 May 24 10:21:21.372587 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 376/759] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:21 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:22.389726 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:22.390422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:22.397424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:22.397928 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:22.398753 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:22.399246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:22.571934 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:22.579972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:22.581590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:22.582790 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1e821e70-e80a-470b-a919-eaaa06a59393 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.197132 May 24 10:21:22.583347 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 384/760] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:22 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:23.602676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:23.603424 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:23.610930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:23.618903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:23.618903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:23.618903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:23.647137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:23.648013 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:23.654907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:23.655351 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:23.656151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:23.656579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:23.751142 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lazy-loading 'services' on Instance uuid 71bf57e3-86a6-4440-9210-a889d5b1adaf {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:21:23.762810 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:23.773275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:23.775859 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:23.778312 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-850b584d-f2a0-4358-b203-d4324e069e58 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.180239 May 24 10:21:23.779502 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 377/761] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:23 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:23.963992 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e5e78fb1-2998-4178-bcd6-af8adbd5ed23 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments/cab67231-cd91-4a52-99bc-6db853fa1bdb" status: 202 len: 0 microversion: 2.1 time: 0.320564 May 24 10:21:23.964587 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 385/762] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:21:23 2022] DELETE /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments/cab67231-cd91-4a52-99bc-6db853fa1bdb => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:21:23.973917 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-07afa961-3bfa-4b30-8a2a-39f08e267874 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:23.974833 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-07afa961-3bfa-4b30-8a2a-39f08e267874 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:23.981056 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07afa961-3bfa-4b30-8a2a-39f08e267874 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:23.981508 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07afa961-3bfa-4b30-8a2a-39f08e267874 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:23.982272 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07afa961-3bfa-4b30-8a2a-39f08e267874 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:23.982705 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-07afa961-3bfa-4b30-8a2a-39f08e267874 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:24.011027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-07afa961-3bfa-4b30-8a2a-39f08e267874 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 May 24 10:21:24.011580 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 378/763] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:21:23 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:21:24.796956 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:24.797909 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:24.805636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:24.806309 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:24.813347 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:24.813347 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:25.023058 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-999e3e18-724d-490e-af10-edcc1be2d0fa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:25.024675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-999e3e18-724d-490e-af10-edcc1be2d0fa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:25.031856 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-999e3e18-724d-490e-af10-edcc1be2d0fa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:25.032530 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-999e3e18-724d-490e-af10-edcc1be2d0fa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:25.033303 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-999e3e18-724d-490e-af10-edcc1be2d0fa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:25.033941 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-999e3e18-724d-490e-af10-edcc1be2d0fa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:25.072950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-999e3e18-724d-490e-af10-edcc1be2d0fa tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054264 May 24 10:21:25.074216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 379/764] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:21:25 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 24 10:21:25.105286 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:25.114529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:25.116107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:25.117255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7c893693-f34f-44e8-9954-11342ee65116 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.324495 May 24 10:21:25.117801 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 386/765] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:24 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:25.138620 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:25.139109 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:25.146004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:25.146450 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:25.147208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:25.147639 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:25.172536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:21:25.456501 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4c3d768a-3779-4900-a732-23b048f1817e tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 204 len: 0 microversion: 2.1 time: 0.320577 May 24 10:21:25.456501 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 380/766] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:21:25 2022] DELETE /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:21:25.464712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:25.465309 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:25.471205 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:25.471658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:25.472486 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:25.473002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:25.601148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:25.608565 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fcf631c8-8942-48eb-9923-f5442ef7de79 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1681 microversion: 2.1 time: 0.147610 May 24 10:21:25.609118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 387/767] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:25 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:21:26.135922 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:26.136604 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:26.143064 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:26.144362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:26.145262 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:26.145698 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:26.279658 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:26.290907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:26.292369 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:26.293630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d61327d9-b997-4568-884a-821a0749fc4b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.162106 May 24 10:21:26.294179 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 381/768] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:26 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:26.626502 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:26.627103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:26.634053 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:26.634499 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:26.635290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:26.635720 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:26.764846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:26.772967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2bf2e6a4-613f-4f05-a432-efdbe5c0c182 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1681 microversion: 2.1 time: 0.150327 May 24 10:21:26.773555 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 388/769] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:26 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:21:27.311784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:27.312403 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:27.319479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:27.320024 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:27.320791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:27.321225 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:27.452269 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:27.461101 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:27.462623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:27.463808 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2d4e9d8d-18e0-4855-9965-31e881703423 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.155979 May 24 10:21:27.464392 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 382/770] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:27 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:27.790274 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:27.791516 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:27.798545 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:27.798995 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:27.800502 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:27.801100 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:27.866527 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:27.874260 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9c5747a3-c13f-4952-816d-273ce9952098 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1613 microversion: 2.1 time: 0.087937 May 24 10:21:27.875171 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 389/771] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:27 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:21:28.109266 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-7531ebc8-d225-48c6-a466-9ca90a517e74 req-43cb8d45-1f2c-4f45-90c8-c19d99ab994b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bf57e3-86a6-4440-9210-a889d5b1adaf", "name": "network-vif-deleted", "tag": "dccc4943-96f4-4376-ac15-8ded589eca1e"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:28.117881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-7531ebc8-d225-48c6-a466-9ca90a517e74 req-43cb8d45-1f2c-4f45-90c8-c19d99ab994b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:28.118322 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-7531ebc8-d225-48c6-a466-9ca90a517e74 req-43cb8d45-1f2c-4f45-90c8-c19d99ab994b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:28.129451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-7531ebc8-d225-48c6-a466-9ca90a517e74 req-43cb8d45-1f2c-4f45-90c8-c19d99ab994b service nova] Creating event network-vif-deleted:dccc4943-96f4-4376-ac15-8ded589eca1e for instance 71bf57e3-86a6-4440-9210-a889d5b1adaf on hv-cinder-81045 May 24 10:21:28.134336 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-7531ebc8-d225-48c6-a466-9ca90a517e74 req-43cb8d45-1f2c-4f45-90c8-c19d99ab994b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028794 May 24 10:21:28.135151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 383/772] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:21:28.483666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:28.483666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:28.490304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:28.490750 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:28.491589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:28.492080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:28.628690 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:28.636995 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:28.640752 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:28.645118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1afb30e3-6f00-4d36-be3a-e50e6c806313 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.163472 May 24 10:21:28.645118 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 390/773] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:28 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:21:28.892396 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:28.893130 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:28.900274 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:28.900728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:28.901499 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:28.901931 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:28.937500 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:28.938023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:28.938479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lazy-loading 'fault' on Instance uuid 71bf57e3-86a6-4440-9210-a889d5b1adaf {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:21:28.993046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06e9e172155548289ca938421d4e32bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b9157df136454d83302d24d1768d59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:29.001449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1748ccbd-d52b-478e-a57f-736368979369 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 200 len: 1330 microversion: 2.1 time: 0.113978 May 24 10:21:29.002017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 384/774] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:28 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:21:29.660272 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:29.661001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:29.667522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:29.668002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:29.668766 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:29.669188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:29.801060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:29.808805 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:29.810283 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:29.811421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a5532f24-7849-4718-993a-5a73b1578d14 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.155043 May 24 10:21:29.812016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 391/775] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:29 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:30.018951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:30.019524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:30.025911 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:30.026355 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:30.032066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:30.032066 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:30.042125 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf HTTP/1.1 May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:30.043774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:30.045505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '71bf57e3-86a6-4440-9210-a889d5b1adaf'} May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:30.046531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:30.048203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:30.049545 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:30.049545 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-65b32185-b44b-42f9-9b02-2738e9c5ca9d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 404 len: 111 microversion: 2.1 time: 0.030697 May 24 10:21:30.049545 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 385/776] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:30 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:30.055129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a24c9484-be80-4987-96e5-9484d00a4ebc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '.version_select at 0x7ff63affc310>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:30.129121 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a24c9484-be80-4987-96e5-9484d00a4ebc tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527346113" status: 202 len: 0 microversion: 2.1 time: 0.077822 May 24 10:21:30.129770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 392/777] 10.222.0.44 () {58 vars in 1217 bytes} [Tue May 24 10:21:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527346113 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:21:30.829522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:30.830153 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:30.836648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:30.837098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:30.837850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:30.838274 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:30.978238 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:30.985994 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:30.988273 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:30.989425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3b579061-1b17-4ea8-845e-6abffba00e22 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.163777 May 24 10:21:30.989991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 386/778] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:30 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:32.007153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:32.007815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:32.013742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:32.014188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:32.014965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:32.015396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:32.152935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:32.167608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:32.168134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:32.172534 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:32.174755 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:32.174904 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:32.175303 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:32.176196 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:32.176626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:32.177115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8cae000e-5448-4fc0-b074-25bb18a5c3b9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.174449 May 24 10:21:32.177830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 393/779] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:32 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:32.194483 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf HTTP/1.1 May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:32.196108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.197858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '71bf57e3-86a6-4440-9210-a889d5b1adaf'} May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:32.198762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.200395 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:32.202286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:32.202286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-76f5f52e-fcf7-4140-b2af-f5a90e2cebdb tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 404 len: 111 microversion: 2.1 time: 0.033759 May 24 10:21:32.202286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 387/780] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:21:32 2022] DELETE /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:32.206527 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:32.207272 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 71bf57e3-86a6-4440-9210-a889d5b1adaf] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:32.213521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:32.214297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:32.214826 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:32.215253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:32.228599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf HTTP/1.1 May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:32.230246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.231886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '71bf57e3-86a6-4440-9210-a889d5b1adaf'} May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:32.232810 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. May 24 10:21:32.234323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:32.237789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 71bf57e3-86a6-4440-9210-a889d5b1adaf could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:32.237789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1783254a-2279-496f-ae2c-8414feba9404 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf" status: 404 len: 111 microversion: 2.1 time: 0.029564 May 24 10:21:32.237789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 394/781] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:32 2022] GET /compute/v2.1/servers/71bf57e3-86a6-4440-9210-a889d5b1adaf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:33.196079 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:33.196674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:33.203042 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.203479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.204265 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.204733 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.339892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:33.348762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:33.350265 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:33.351420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-65273f2d-1859-45a5-91e0-49bf3fe0861e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.159274 May 24 10:21:33.352271 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 388/782] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:33 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:33.566435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:33.566942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:33.573615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.574063 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.574824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.575281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.589610 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a HTTP/1.1 May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:33.591168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.592886 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'a9a59bc4-faf8-4394-9fc6-fd0acdf1215a'} May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:33.593815 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.595399 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.598048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:33.598048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fce19afd-ae4f-4573-87cd-5e0e17e5397b tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 404 len: 111 microversion: 2.1 time: 0.030224 May 24 10:21:33.598048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 395/783] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:21:33 2022] DELETE /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:33.601646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:33.602250 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: a9a59bc4-faf8-4394-9fc6-fd0acdf1215a] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:33.608089 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.608529 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.609281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.609702 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.613837 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:33.622708 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a HTTP/1.1 May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:33.629855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.631816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': 'a9a59bc4-faf8-4394-9fc6-fd0acdf1215a'} May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:33.633201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. May 24 10:21:33.634660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.635993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance a9a59bc4-faf8-4394-9fc6-fd0acdf1215a could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:33.635993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7f2f2430-a2da-4427-8b93-1fa6d71c9175 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a" status: 404 len: 111 microversion: 2.1 time: 0.027586 May 24 10:21:33.635993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 389/784] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:33 2022] GET /compute/v2.1/servers/a9a59bc4-faf8-4394-9fc6-fd0acdf1215a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:33.636532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:33.637016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:33.643215 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.644228 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.645511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.645946 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.661089 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 HTTP/1.1 May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:33.662627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.664227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '308bf397-c164-4d23-a78c-1a711d547789'} May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:33.665147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.666598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:33.668120 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:33.668120 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-32efb9d7-11e5-476a-8bf1-dc136753ef5d tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 404 len: 111 microversion: 2.1 time: 0.031230 May 24 10:21:33.668120 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 396/785] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:21:33 2022] DELETE /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:33.672633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:33.673306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 308bf397-c164-4d23-a78c-1a711d547789] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:33.680260 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.681317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.681513 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:33.681957 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:33.697449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 HTTP/1.1 May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:33.698986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.700565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '308bf397-c164-4d23-a78c-1a711d547789'} May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:33.701471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. May 24 10:21:33.702995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:33.704441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 308bf397-c164-4d23-a78c-1a711d547789 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:33.704441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-12f17069-99f7-487c-aff3-3aec6716d65f tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789" status: 404 len: 111 microversion: 2.1 time: 0.031586 May 24 10:21:33.704441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 390/786] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:33 2022] GET /compute/v2.1/servers/308bf397-c164-4d23-a78c-1a711d547789 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:34.369357 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:34.370123 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:34.376441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:34.376889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:34.377665 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:34.378127 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:34.514567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:34.516956 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:34.524032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:34.525517 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:34.526668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-16b3f1be-257d-4a1a-b633-92ac4fb687de tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.161264 May 24 10:21:34.527205 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 397/787] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:34 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:34.952344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:34.952852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:34.960944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:34.961391 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:34.962153 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:34.962588 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:34.975720 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 HTTP/1.1 May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:21:34.977374 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:34.979012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '13731d69-8592-481c-b267-3415c90f91a1'} May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:34.979846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:34.981138 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:21:34.982418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:34.982418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cbc49cbd-74be-4c86-b559-7f73d0852de0 tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "DELETE /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 404 len: 111 microversion: 2.1 time: 0.030317 May 24 10:21:34.982418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 391/788] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:21:34 2022] DELETE /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:34.987562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:34.988186 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] [instance: 13731d69-8592-481c-b267-3415c90f91a1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:34.995322 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:34.995775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:34.996563 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:34.997001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:35.013944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] HTTP exception thrown: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Request method failure captured: May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 HTTP/1.1 May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLAInkGPFyjPV9Zx-Fv4hfR-i16aUCIvi-QIeOIrFIXgqs-MeXSKjKFbGdWE9_L1RXNU517I7BXqopqNMOCF71Hb3u7dJkpI8vwoaP74SYXTZ9aio6SYHlfyt96fGhS7a_1vaOg44Gw4HXPLDTIkHExg_fE-x_LweABtfzaOhBCrimQ May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:21:35.015547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/20b9157df136454d83302d24d1768d59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_20b9157df136454d83302d24d1768d59", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/20b9157df136454d83302d24d1768d59"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: 20b9157df136454d83302d24d1768d59 May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1645152129 May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 06e9e172155548289ca938421d4e32bf May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeNegativeTest-1645152129-project May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:35.017054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '13731d69-8592-481c-b267-3415c90f91a1'} May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:21:35.017935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. May 24 10:21:35.019325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:21:35.020636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] Returning 404 to user: Instance 13731d69-8592-481c-b267-3415c90f91a1 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:21:35.020636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d7c59a2d-f845-47bc-b4d8-9a9824cae91a tempest-AttachVolumeNegativeTest-1645152129 tempest-AttachVolumeNegativeTest-1645152129-project] 10.222.0.44 "GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1" status: 404 len: 111 microversion: 2.1 time: 0.033884 May 24 10:21:35.020636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 398/789] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:21:34 2022] GET /compute/v2.1/servers/13731d69-8592-481c-b267-3415c90f91a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:21:35.545935 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:35.546448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:35.553471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:35.553923 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:35.554729 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:35.555173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:35.766377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:35.775148 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:35.776674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:35.777858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5df225ba-773c-4dc2-a9ac-fef0467bd8c8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1744 microversion: 2.20 time: 0.236295 May 24 10:21:35.778510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 392/790] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:35 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:36.796916 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:36.797590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:36.807531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:36.810622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:36.810622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:36.810622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:37.023389 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:37.037147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:37.040896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:37.042365 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-42b87741-ed25-4b22-b5b8-8570d029dd45 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.249444 May 24 10:21:37.043084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 399/791] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:36 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:38.062193 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:38.063389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:38.071465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:38.071958 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:38.072906 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:38.073330 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:38.242305 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:38.255284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:38.257296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:38.261980 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-58e1d922-a650-4d52-894f-3dc5e7368dbd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.203254 May 24 10:21:38.262764 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 393/792] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:38 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:21:39.281008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:39.282207 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:39.295419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:39.299082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:39.301429 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:39.302131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:39.550912 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:39.567009 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:39.569340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:39.570691 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-08bda2d9-ae56-464b-beb4-8db750ad7128 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.294366 May 24 10:21:39.572807 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 400/793] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:39 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:39.802602 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-3d9903ce-d3a6-4ca3-9df8-3151ec516d2c req-bb1dfb49-c148-48d4-9d93-fb44b6d2a5df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe007745-7114-45bd-beef-67cbecf48624", "name": "network-vif-plugged", "status": "completed", "tag": "a2beb885-96ae-4021-a2ba-85363ba17a9f"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:39.814348 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-3d9903ce-d3a6-4ca3-9df8-3151ec516d2c req-bb1dfb49-c148-48d4-9d93-fb44b6d2a5df service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:39.817699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-3d9903ce-d3a6-4ca3-9df8-3151ec516d2c req-bb1dfb49-c148-48d4-9d93-fb44b6d2a5df service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:39.840285 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-3d9903ce-d3a6-4ca3-9df8-3151ec516d2c req-bb1dfb49-c148-48d4-9d93-fb44b6d2a5df service nova] Creating event network-vif-plugged:a2beb885-96ae-4021-a2ba-85363ba17a9f for instance fe007745-7114-45bd-beef-67cbecf48624 on hv-cinder-81045 May 24 10:21:39.846527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-3d9903ce-d3a6-4ca3-9df8-3151ec516d2c req-bb1dfb49-c148-48d4-9d93-fb44b6d2a5df service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048130 May 24 10:21:39.851133 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 394/794] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:21:40.593727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:40.594996 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:40.604050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:40.604768 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:40.606446 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:40.607062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:40.809210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:40.819155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:40.821253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:40.822593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-38826378-ab88-4ac5-82c7-dc4854326d43 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.232887 May 24 10:21:40.823156 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 401/795] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:40 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:41.842092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:41.842845 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:41.852377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:41.852377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:41.853297 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:41.853905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:42.012956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:42.021478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:42.039362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:42.039362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ad067b4d-1cc3-4450-88ef-932c781306d3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.187375 May 24 10:21:42.039362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 395/796] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:41 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:21:43.046876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:43.048343 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:43.056849 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:43.057630 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:43.058735 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:43.059387 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:43.223765 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:43.233024 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:43.236347 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:43.238531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ceb45fb6-4dbf-4884-a156-bbb0f9066d18 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.195672 May 24 10:21:43.239552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 402/797] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:43 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:44.257361 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:44.258042 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:44.264459 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:44.264910 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:44.265668 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:44.266100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:44.412899 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:44.421149 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:44.422675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:44.423882 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-02f34a34-33ec-4baf-bb13-e0b548441913 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.170430 May 24 10:21:44.429275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 396/798] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:44 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:45.443446 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:45.444080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:45.460258 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:45.461858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:45.462312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:45.463107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:45.463541 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:45.629950 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:45.640723 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:45.643336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:45.644960 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-32178527-8214-4c91-906a-48842ef507f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.206449 May 24 10:21:45.646109 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 403/799] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:45 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:46.672364 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:46.673944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:46.681767 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:21:46.684100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:46.684769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:46.686114 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:46.686700 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:46.902158 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:46.914418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:46.915939 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:46.917109 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-076f3a02-ea56-4141-9a76-476299dcd890 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.256500 May 24 10:21:46.917941 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 397/800] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:46 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:47.936781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:47.937417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:47.944064 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:47.944514 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:47.945632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:47.946112 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:48.089538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:48.100304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:48.103220 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:48.104726 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-97d0c67a-35de-4505-8a5d-222a8f9e478f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.171882 May 24 10:21:48.116153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 404/801] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:47 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:49.126734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:49.128142 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:49.134549 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:49.143168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:49.143168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:49.143168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:49.275263 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:49.283399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:49.285101 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:49.286246 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-473672c4-8416-48e9-bee9-62a94c59a035 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1739 microversion: 2.20 time: 0.164830 May 24 10:21:49.287052 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 398/802] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:49 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:50.306682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:50.306682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:50.312673 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:50.313123 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:50.313889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:50.314323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:50.462621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:50.475378 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:50.476903 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:50.478067 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ff6a0e6d-1132-4427-ade2-9a5cf0bf58d8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1721 microversion: 2.20 time: 0.177511 May 24 10:21:50.478666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 405/803] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:50 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:51.497260 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:51.497910 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:51.505512 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:51.505957 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:51.506715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:51.507173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:51.643059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:51.650924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:51.652676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:51.653891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-186ce25a-1d81-4567-9eea-bb63ef35c6f1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1721 microversion: 2.20 time: 0.160524 May 24 10:21:51.654437 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 399/804] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:51 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:52.672041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:52.672642 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:52.680056 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:52.681301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:52.681301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:52.682173 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:52.828135 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:52.838468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:52.840038 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:52.841228 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bf67a943-d9f5-4008-8ee1-50bc57d0d519 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1724 microversion: 2.20 time: 0.173237 May 24 10:21:52.841777 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 406/805] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:52 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:52.861021 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e832f42e-d39f-4e91-859c-1e35a82139a1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99c50055-d2c9-4b3d-85a4-852f4c521b83"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:52.862072 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e832f42e-d39f-4e91-859c-1e35a82139a1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:52.868859 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e832f42e-d39f-4e91-859c-1e35a82139a1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:52.869304 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e832f42e-d39f-4e91-859c-1e35a82139a1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:52.870184 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e832f42e-d39f-4e91-859c-1e35a82139a1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:52.883698 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e832f42e-d39f-4e91-859c-1e35a82139a1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:53.783270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-d17931a9-e3c5-460d-bf4b-83943eb37b96 req-cf4303e5-c558-40f5-b132-ab81499f229f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe007745-7114-45bd-beef-67cbecf48624", "name": "network-vif-unplugged", "status": "completed", "tag": "a2beb885-96ae-4021-a2ba-85363ba17a9f"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:53.792639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-d17931a9-e3c5-460d-bf4b-83943eb37b96 req-cf4303e5-c558-40f5-b132-ab81499f229f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:53.793081 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-d17931a9-e3c5-460d-bf4b-83943eb37b96 req-cf4303e5-c558-40f5-b132-ab81499f229f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:53.804015 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.compute.server_external_events [req-d17931a9-e3c5-460d-bf4b-83943eb37b96 req-cf4303e5-c558-40f5-b132-ab81499f229f service nova] Unable to find a host for instance fe007745-7114-45bd-beef-67cbecf48624. Dropping event network-vif-unplugged {{(pid=118130) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 24 10:21:53.805129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-d17931a9-e3c5-460d-bf4b-83943eb37b96 req-cf4303e5-c558-40f5-b132-ab81499f229f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035190 May 24 10:21:53.805705 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 407/806] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 24 10:21:53.909184 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e832f42e-d39f-4e91-859c-1e35a82139a1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.052996 May 24 10:21:53.910575 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 400/807] 10.222.0.44 () {62 vars in 1363 bytes} [Tue May 24 10:21:52 2022] POST /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments => generated 188 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 24 10:21:54.045389 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f0ac0092-d7e5-4484-9951-eb00ab750adf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:21:54.046002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f0ac0092-d7e5-4484-9951-eb00ab750adf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:54.053393 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ac0092-d7e5-4484-9951-eb00ab750adf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:54.053868 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ac0092-d7e5-4484-9951-eb00ab750adf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:54.054706 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ac0092-d7e5-4484-9951-eb00ab750adf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:54.055183 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ac0092-d7e5-4484-9951-eb00ab750adf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:54.323642 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f0ac0092-d7e5-4484-9951-eb00ab750adf tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/action" status: 202 len: 0 microversion: 2.20 time: 0.282000 May 24 10:21:54.327459 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 408/808] 10.222.0.44 () {62 vars in 1318 bytes} [Tue May 24 10:21:54 2022] POST /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:21:54.332531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:54.333132 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:54.351268 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:54.351824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:54.352691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:54.353211 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:54.500654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:54.512167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:54.512167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:54.512846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-74c0e54b-a758-4678-ac95-8dd7ed0f81fd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1750 microversion: 2.20 time: 0.184330 May 24 10:21:54.513394 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 401/809] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:54 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:55.531907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:55.532659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:55.540335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:55.541020 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:55.542090 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:55.542451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:55.674552 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:55.684915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:55.686422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:55.687589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e496b13b-ee05-487a-b9d4-a46a796f3ef4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1750 microversion: 2.20 time: 0.160586 May 24 10:21:55.688164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 409/810] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:55 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:56.706075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:56.707404 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:56.714114 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:56.714563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:56.715345 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:56.715818 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:56.849923 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:56.858610 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:56.860286 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:56.861441 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-33f507b4-c6b0-4588-91f8-46b8af7c8eae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1752 microversion: 2.20 time: 0.159334 May 24 10:21:56.861998 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 402/811] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:56 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:57.881247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:57.881685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:57.889583 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:57.890202 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:57.891202 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:57.891817 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:58.040780 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:58.049532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:58.051738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:58.053168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-12dd15cf-e992-4be3-b6da-9ae947b6f7e1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1752 microversion: 2.20 time: 0.177123 May 24 10:21:58.053917 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 410/812] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:57 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:21:59.072011 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:21:59.075137 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:21:59.079016 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:59.079466 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:59.080280 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:21:59.080737 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:21:59.217236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:59.226177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:59.228123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:21:59.229417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4537924f-f5a6-4847-bbb8-f51b760be092 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.161186 May 24 10:21:59.230498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 403/813] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:21:59 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:00.249026 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:00.250369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:00.262414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:00.264640 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:00.265640 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:00.266243 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:00.474851 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:00.485948 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:00.489077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:00.490162 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7a6069a2-127a-4ecc-9298-081645c6f535 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.246433 May 24 10:22:00.491104 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 411/814] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:00 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:01.510988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:01.512150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:01.519224 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:01.519841 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:01.520646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:01.521121 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:01.760988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:01.788075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:01.790561 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:01.791782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d4cb4181-c44f-4440-9e6a-f056db847bbb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.286797 May 24 10:22:01.792372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 404/815] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:01 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:02.812693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:02.814077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:02.825057 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:02.825760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:02.828392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:02.834430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:03.277561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:03.297538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:03.299458 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:03.301955 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ded8eb77-cc16-4f01-8259-c318ae20958e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.493297 May 24 10:22:03.303198 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 412/816] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:02 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:04.321263 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:04.321905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:04.328625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:04.329075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:04.329951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:04.330451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:04.488498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:04.492873 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:04.500489 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:04.502860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:04.504668 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-438da177-af25-4219-8668-799552df3503 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.187194 May 24 10:22:04.505514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 405/817] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:04 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:22:05.530931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:05.530931 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:05.540442 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:05.540889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:05.541668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:05.542103 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:05.698516 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:05.714293 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:05.717663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:05.723499 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-56fcdecc-945f-48f2-8f1a-00203592878c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.202688 May 24 10:22:05.726787 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 413/818] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:05 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:06.745139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:06.746469 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:06.787921 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:06.790542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:06.790542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:06.790542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:06.977822 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:06.986686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:06.989056 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:06.990232 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ecb6b509-e60b-4369-8ff5-0030d84976c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.250481 May 24 10:22:07.001768 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 406/819] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:06 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:08.008232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:08.008978 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:08.015588 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:08.016365 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:08.017246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:08.017892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:08.022899 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:08.193885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:08.202814 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:08.204867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:08.206349 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-331a621e-00e1-4ae8-88f4-ae250f01d853 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.201902 May 24 10:22:08.207183 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 414/820] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:08 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:22:09.225897 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:09.226550 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:09.233229 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:09.233684 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:09.234455 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:09.234891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:09.478955 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:09.488027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:09.489608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:09.490898 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f3b25f64-141b-4a3f-a426-748d4fae7c56 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.269263 May 24 10:22:09.491301 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 407/821] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:09 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:10.509899 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:10.510445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:10.517758 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:10.524176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:10.524176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:10.524176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:10.819040 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:10.839894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:10.843376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:10.845846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-52f27a52-13a3-4999-9193-f49bf90dd093 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.340319 May 24 10:22:10.847156 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 415/822] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:10 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:11.869708 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:11.870233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:11.892168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:11.898975 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:11.900158 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:11.900747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:12.124983 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:12.134413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:12.136512 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:12.149894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-815de962-6cad-4369-8603-39ddc1165f0c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.277664 May 24 10:22:12.149894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 408/823] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:11 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:13.161827 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:13.164147 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:13.173049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:13.174473 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:13.176130 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:13.176975 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:13.802926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:13.814108 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:13.815658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:13.821382 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8ca5c046-8d10-43af-817b-9618a607d319 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.669120 May 24 10:22:13.821977 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 416/824] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:13 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:14.841147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:14.841702 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:14.852772 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:14.852772 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:14.852772 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:14.852772 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:15.035581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:15.044527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:15.045653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:15.047083 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-16e43b42-a3b3-489f-b014-1403a128e76f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.210921 May 24 10:22:15.048053 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 409/825] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:14 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:16.066821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:16.067500 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:16.091973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=30 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:16.091973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:16.091973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:16.096992 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:16.096992 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:16.323732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:16.340107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:16.345717 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:16.347016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-64dc1d8e-c510-4a3c-bbb7-386c6e74f78f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.284876 May 24 10:22:16.347587 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 417/826] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:16 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:17.368312 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:17.370125 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:17.404554 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:17.412209 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:17.414183 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:17.414812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:17.650438 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:17.661112 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:17.682573 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:17.691482 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ba05dac3-e8da-4ee5-8894-ef9cb1386cd1 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.326089 May 24 10:22:17.694072 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 410/827] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:17 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:18.032354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-3782ce57-2762-443a-887b-19448d9ff1ed req-977a1151-d462-4a51-ae85-061a85a102a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe007745-7114-45bd-beef-67cbecf48624", "name": "network-vif-plugged", "status": "completed", "tag": "a2beb885-96ae-4021-a2ba-85363ba17a9f"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:18.042062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-3782ce57-2762-443a-887b-19448d9ff1ed req-977a1151-d462-4a51-ae85-061a85a102a0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:18.042508 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-3782ce57-2762-443a-887b-19448d9ff1ed req-977a1151-d462-4a51-ae85-061a85a102a0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:18.058966 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-3782ce57-2762-443a-887b-19448d9ff1ed req-977a1151-d462-4a51-ae85-061a85a102a0 service nova] Creating event network-vif-plugged:a2beb885-96ae-4021-a2ba-85363ba17a9f for instance fe007745-7114-45bd-beef-67cbecf48624 on hv-cinder-81045 May 24 10:22:18.069029 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-3782ce57-2762-443a-887b-19448d9ff1ed req-977a1151-d462-4a51-ae85-061a85a102a0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040584 May 24 10:22:18.070825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 418/828] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:22:18.720087 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:18.720087 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:18.722920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:18.723427 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:18.724409 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:18.724850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:18.972206 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:18.991612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:18.994954 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:18.998879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4b61ba9b-2955-4906-89a0-e14aae7cf17d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.292120 May 24 10:22:19.000373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 411/829] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:18 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:20.019457 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:20.020281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:20.032327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:20.035779 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:20.036830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:20.042171 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:20.323769 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:20.339129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:20.343375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:20.352262 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b22e3cb9-0a25-42ce-82fa-7226d7fb84cb tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.338129 May 24 10:22:20.364304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 419/830] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:20 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:21.374068 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:21.376375 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:21.389657 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:21.399176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:21.401713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:21.402599 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:21.724979 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:21.751680 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:21.754003 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:21.755214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6aac6f9b-9d9e-4194-80de-83ef4b096182 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1808 microversion: 2.20 time: 0.387372 May 24 10:22:21.758187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 412/831] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:21 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:22.777499 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:22.778096 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:22.788512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:22.789254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:22.792672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:22.793120 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:23.079685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:23.103874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:23.114040 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:23.115417 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-00b163c7-be3e-4ced-af8c-c497257f273b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1795 microversion: 2.20 time: 0.342080 May 24 10:22:23.116128 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 420/832] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:22:22 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1795 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:22:26.145084 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-72c9a25e-2b7d-44c1-9c7d-9c3146edb1b6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Action: 'create', calling method: .version_select at 0x7ff63ae03790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1027808749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmsUaMKcGk6RfHrKyM9dz07meIJhNqnvmQGwHohk69xEROXWJmwBY3IQXA+XFuxMQf0tTRLRAlDe0Kkio0yOEYIDNEcG5aPvkeHEIeEF9AV9j+RoBMRuwxD0wbBx+Tk7g=="}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:26.166804 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=32 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:26.190272 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-72c9a25e-2b7d-44c1-9c7d-9c3146edb1b6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Getting quotas for project b866575bf960414ba6be2ac0fffe5e11. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:22:26.195783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-72c9a25e-2b7d-44c1-9c7d-9c3146edb1b6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Getting quotas for user a21f92d1ca604c0f9c93b81ed0904a08 and project b866575bf960414ba6be2ac0fffe5e11. Resources: {'key_pairs'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:22:26.285558 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-72c9a25e-2b7d-44c1-9c7d-9c3146edb1b6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.508187 May 24 10:22:26.286515 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 413/833] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:22:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:22:37.195756 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-58b4b009-d232-4c87-b90c-de1905eb8ad6 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Action: 'create', calling method: .version_select at 0x7ff63ae19310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-697877463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMkw10DRkRpGNpBUu0iGVa1HcRPNsxaObRpG8QXbZHWFZowovPFrU0Yo6KaPxOX22Q2mGGnK+Zfa743dBfBHlgvfKZqCSH76tmPBabglPlJ+Nw4uiCtCyirfpZ168jhlQ=="}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:37.200511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=7 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:37.201215 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=37 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:37.212604 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-58b4b009-d232-4c87-b90c-de1905eb8ad6 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Getting quotas for project f4c9c14cf4bc42878a2f63a0ffa2762e. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:22:37.216410 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-58b4b009-d232-4c87-b90c-de1905eb8ad6 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Getting quotas for user c793637b93de4def9e2dd271c96f26a2 and project f4c9c14cf4bc42878a2f63a0ffa2762e. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:22:37.302160 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-58b4b009-d232-4c87-b90c-de1905eb8ad6 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.112886 May 24 10:22:37.302754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 421/834] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:22:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:22:37.347972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=42 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:37.348888 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:37.349446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:37.353315 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2040773831", "imageRef": "b66dc9a7-38e2-4c32-897b-e7781325dc04", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-697877463", "networks": [{"uuid": "f18a2e7f-3ac3-4759-a0fe-a0f73c30267f"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:37.406846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] validate_networks() for [('f18a2e7f-3ac3-4759-a0fe-a0f73c30267f', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:22:37.868718 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:22:37.869163 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:22:37.869625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:22:37.870060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:22:37.870464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:22:37.879597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:37.880063 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:37.880847 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:37.881274 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:37.897105 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Getting quotas for project f4c9c14cf4bc42878a2f63a0ffa2762e. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:22:37.900926 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Getting quotas for user c793637b93de4def9e2dd271c96f26a2 and project f4c9c14cf4bc42878a2f63a0ffa2762e. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:22:37.913335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:22:37.915642 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b66dc9a7-38e2-4c32-897b-e7781325dc04',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:22:38.024913 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-dabf4de3-2659-4577-9441-ae087f2c009d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678078 May 24 10:22:38.025552 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 414/835] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:22:38.036479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e8e58542-4a3f-4520-822d-a64cf796ccc7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:38.037220 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e8e58542-4a3f-4520-822d-a64cf796ccc7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:38.093548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e8e58542-4a3f-4520-822d-a64cf796ccc7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:38.101222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e8e58542-4a3f-4520-822d-a64cf796ccc7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1258 microversion: 2.1 time: 0.069615 May 24 10:22:38.101797 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 422/836] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:38 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:39.119398 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c4a66206-f018-4255-bbaa-056acb095008 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:39.120010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c4a66206-f018-4255-bbaa-056acb095008 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:39.176644 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c4a66206-f018-4255-bbaa-056acb095008 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:39.191120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c4a66206-f018-4255-bbaa-056acb095008 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1258 microversion: 2.1 time: 0.075293 May 24 10:22:39.191721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 415/837] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:39 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:22:40.208872 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:40.209602 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:40.217159 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:40.217813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:40.218592 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:40.219032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:40.282492 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:40.290682 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5e0bf402-badb-4eb6-8dbc-911a2f3bf84c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1262 microversion: 2.1 time: 0.086741 May 24 10:22:40.291235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 423/838] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:40 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:41.306670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:41.307208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:41.313638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:41.314078 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:41.315002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:41.316039 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:41.376782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:41.384336 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3b39c583-0485-48c3-891b-5421d6e1b924 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1262 microversion: 2.1 time: 0.081496 May 24 10:22:41.384922 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 416/839] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:41 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:42.401122 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:42.401726 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:42.408030 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:42.408526 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:42.409289 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:42.409722 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:42.471893 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:42.481467 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-37cb5c57-a0ea-4f2a-b9fa-d1962e739177 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1318 microversion: 2.1 time: 0.084007 May 24 10:22:42.482034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 424/840] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:42 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1318 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:43.498474 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:43.499082 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:43.506216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:43.506679 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:43.507451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:43.507912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:43.643790 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:43.651872 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-cc1913f9-d7c1-4715-98cd-94650997a33c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.157160 May 24 10:22:43.652620 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 417/841] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:43 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:44.669237 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:44.669792 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:44.675888 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:44.676337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:44.677109 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:44.677582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:44.813128 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:44.821490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-76c07da3-5f33-4dbd-b70c-931e08779e57 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.156219 May 24 10:22:44.822065 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 425/842] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:44 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:45.530727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1606706184", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1027808749", "security_groups": [{"name": "tempest-secgroup-smoke-439545902"}], "networks": [{"uuid": "0dbb3c26-586a-4a46-9d4a-f080f03d6f50"}], "block_device_mapping_v2": [{"uuid": "ca403c80-be2d-4ef5-b1f3-93025db622b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:45.653779 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] validate_networks() for [('0dbb3c26-586a-4a46-9d4a-f080f03d6f50', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:22:45.839605 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:45.840766 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:45.847970 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:45.848634 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:45.849938 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:45.850370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:46.097823 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:46.107468 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ac74687e-1763-4e85-a868-37af870e5a04 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.272107 May 24 10:22:46.118292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 426/843] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:45 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:22:46.152098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:22:46.152543 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:22:46.153050 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:22:46.153626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:22:46.153835 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:22:46.162934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:46.163386 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:46.164255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:46.164689 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:46.183389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Getting quotas for project b866575bf960414ba6be2ac0fffe5e11. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:22:46.187168 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Getting quotas for user a21f92d1ca604c0f9c93b81ed0904a08 and project b866575bf960414ba6be2ac0fffe5e11. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:22:46.246006 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:22:46.248087 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca403c80-be2d-4ef5-b1f3-93025db622b1',volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:22:46.645259 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-475ec0e9-2b71-496d-8101-1e48f3fd6f68 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.118317 May 24 10:22:46.647272 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 418/844] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:22:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:22:46.656595 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2e204fec-6680-4c8a-92e3-07cfb8db1db7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:46.657320 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2e204fec-6680-4c8a-92e3-07cfb8db1db7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:46.735760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-2e204fec-6680-4c8a-92e3-07cfb8db1db7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:46.744677 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2e204fec-6680-4c8a-92e3-07cfb8db1db7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1089 microversion: 2.1 time: 0.091783 May 24 10:22:46.745628 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 427/845] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:46 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1089 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:47.125817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:47.126430 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:47.137359 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:47.137588 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:47.138269 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:47.138706 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:47.292789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:47.303402 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-59f558ea-c922-441f-8949-dd327a768b67 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.180030 May 24 10:22:47.304023 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 419/846] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:47 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:47.761602 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6d5dfeb2-4b0c-4420-a634-d1296eba5de5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:47.762750 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6d5dfeb2-4b0c-4420-a634-d1296eba5de5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:47.896892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-6d5dfeb2-4b0c-4420-a634-d1296eba5de5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:47.896892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6d5dfeb2-4b0c-4420-a634-d1296eba5de5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1089 microversion: 2.1 time: 0.102696 May 24 10:22:47.896892 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 428/847] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:47 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1089 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:48.346489 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:48.347192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:48.355559 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:48.356372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:48.357330 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:48.357919 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:48.515980 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:48.525223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-eda89819-119f-4bb9-9592-3f6861661c7e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.182411 May 24 10:22:48.527041 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 420/848] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:48 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:48.894814 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:48.896966 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:48.913184 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:48.913771 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:48.914681 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:48.915184 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:48.990776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:48.998645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-84b4c5b1-f211-4439-84cc-2475cfc0644a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1139 microversion: 2.1 time: 0.109307 May 24 10:22:48.999618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 429/849] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:48 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1139 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:49.543326 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:49.543990 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:49.550668 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:49.551117 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:49.552529 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:49.552950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:49.691617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:49.700759 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ed0292f7-ca4b-4699-90a6-72b3f1c96578 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.161479 May 24 10:22:49.701354 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 421/850] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:49 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:50.016616 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:50.017277 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:50.024451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:50.024906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:50.025690 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:50.026176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:50.102621 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:50.111392 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a9108565-d038-4788-b027-fa26f3b28812 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1139 microversion: 2.1 time: 0.098599 May 24 10:22:50.112056 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 430/851] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:50 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1139 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:50.718510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:50.719123 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:50.727018 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:50.727461 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:50.728249 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:50.728678 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:50.854144 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:50.861421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0efa75b0-b7d8-4ee2-ac64-a65ca53b3f6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.147011 May 24 10:22:50.861983 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 422/852] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:50 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:51.128895 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:51.129544 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:51.137178 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:51.137618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:51.138371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:51.138798 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:51.202876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:51.211279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b2b3984c-d0df-46d0-8a0f-f4285834010b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1139 microversion: 2.1 time: 0.086261 May 24 10:22:51.211856 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 431/853] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:51 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:51.882995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:51.883747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:51.890641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:51.891373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:51.892425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:51.892892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:52.026483 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:52.036906 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b3d708a1-d73a-4e47-9b84-deedfde422f2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.161867 May 24 10:22:52.038087 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 423/854] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:51 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:22:52.040510 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-a2202e58-f211-427e-9fa6-a147877457c3 req-c65def04-ffef-42ac-a1ff-823ce80e4bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb5a23e-99b6-483c-b332-5d855d82244d", "tag": "f9920718-056a-45cc-ae00-2c684b12e30c"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:52.051469 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-a2202e58-f211-427e-9fa6-a147877457c3 req-c65def04-ffef-42ac-a1ff-823ce80e4bf7 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:52.052064 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-a2202e58-f211-427e-9fa6-a147877457c3 req-c65def04-ffef-42ac-a1ff-823ce80e4bf7 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:52.070942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-a2202e58-f211-427e-9fa6-a147877457c3 req-c65def04-ffef-42ac-a1ff-823ce80e4bf7 service nova] Creating event network-changed:f9920718-056a-45cc-ae00-2c684b12e30c for instance ebb5a23e-99b6-483c-b332-5d855d82244d on hv-cinder-81045 May 24 10:22:52.078738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-a2202e58-f211-427e-9fa6-a147877457c3 req-c65def04-ffef-42ac-a1ff-823ce80e4bf7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041025 May 24 10:22:52.078738 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 432/855] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:22:52.235397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:52.236070 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:52.243154 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:52.243595 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:52.244388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:52.244818 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:52.313707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:52.322551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b3b75fac-06ef-4892-bdbf-dccfe0c50a9c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1187 microversion: 2.1 time: 0.091072 May 24 10:22:52.332547 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 424/856] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:52 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:53.057065 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:53.058166 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:53.065724 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:53.067288 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:53.067288 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:53.067869 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:53.313727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:53.322282 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4024e12c-71af-4a21-a973-69667ab59417 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.271309 May 24 10:22:53.322863 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 433/857] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:53 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:53.340673 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:53.341309 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:53.348229 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:53.351059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:53.351972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:53.352412 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:53.503127 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:53.510825 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0702f2a0-ac4c-4687-be7d-b8bc0b233e4d tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1272 microversion: 2.1 time: 0.174124 May 24 10:22:53.511385 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 425/858] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:53 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:54.339971 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:54.340706 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:54.347368 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:54.347847 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:54.349169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:54.349680 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:54.526898 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:54.527510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:54.533973 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:54.534475 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:54.535242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:54.535695 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:54.540148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:54.547975 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7501943b-569c-4047-a98c-8483a0ea6e6b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.211828 May 24 10:22:54.548577 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 434/859] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:54 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:54.766213 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:54.776362 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-11f2b0ed-af03-48b4-9981-29432f2ae316 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1272 microversion: 2.1 time: 0.253121 May 24 10:22:54.777311 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 426/860] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:54 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1272 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:22:54.987185 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-34f9f983-eabd-46f5-9529-7d7ac850cecb req-41d488cd-f5c1-4dc2-8ea6-9203fabd56f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b", "tag": "2a0b8e37-c6df-4421-9de0-035e1f941fd5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:54.998500 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-34f9f983-eabd-46f5-9529-7d7ac850cecb req-41d488cd-f5c1-4dc2-8ea6-9203fabd56f0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:55.000203 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-34f9f983-eabd-46f5-9529-7d7ac850cecb req-41d488cd-f5c1-4dc2-8ea6-9203fabd56f0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:55.013451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-34f9f983-eabd-46f5-9529-7d7ac850cecb req-41d488cd-f5c1-4dc2-8ea6-9203fabd56f0 service nova] Creating event network-changed:2a0b8e37-c6df-4421-9de0-035e1f941fd5 for instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b on hv-cinder-81045 May 24 10:22:55.018712 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-34f9f983-eabd-46f5-9529-7d7ac850cecb req-41d488cd-f5c1-4dc2-8ea6-9203fabd56f0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038733 May 24 10:22:55.019294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 435/861] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:22:55.565570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:55.566180 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:55.572858 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:55.573308 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:55.574068 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:55.574504 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:55.782768 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:55.791122 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f44c6a7a-e615-4ab2-bc77-6362b69be46f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.229367 May 24 10:22:55.791691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 427/862] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:55 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:55.794297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:55.795152 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:55.801599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:55.802045 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:55.802922 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:55.803920 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:55.938284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:55.946497 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-911cdd90-d236-4148-b226-586a1333a4a8 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.156945 May 24 10:22:55.947061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 436/863] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:55 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:22:56.808200 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:56.810172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:56.810665 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=4 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:56.811327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=14 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:56.816741 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:56.817190 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:56.817945 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:56.818433 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:56.945141 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:56.952407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7dabcfee-91ff-49eb-b582-a8f6b7f68064 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.148071 May 24 10:22:56.952962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 428/864] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:56 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:56.963980 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:56.964578 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:56.970867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:56.971308 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:56.972092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:56.972522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:57.102090 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:57.109198 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c81e3411-ceb8-43c9-8026-7d849462cd71 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.149317 May 24 10:22:57.109821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 437/865] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:56 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:57.969455 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:57.970063 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:57.977566 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:57.978034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:57.978824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:57.979245 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:58.114728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:58.123092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8df083fb-59f2-4875-ad34-19b28dce5c2e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.157466 May 24 10:22:58.124487 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 429/866] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:57 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:58.126825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:58.127664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:58.129731 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=10 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:22:58.135337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:58.135778 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:58.136578 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:58.137010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:58.204756 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-1df6a178-ad99-4249-89b1-a89943030f01 req-fbc65d45-30ca-4a2a-9a60-fa5b886bd3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb5a23e-99b6-483c-b332-5d855d82244d", "name": "network-vif-plugged", "status": "completed", "tag": "f9920718-056a-45cc-ae00-2c684b12e30c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:22:58.214494 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1df6a178-ad99-4249-89b1-a89943030f01 req-fbc65d45-30ca-4a2a-9a60-fa5b886bd3d8 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:58.215002 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1df6a178-ad99-4249-89b1-a89943030f01 req-fbc65d45-30ca-4a2a-9a60-fa5b886bd3d8 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:58.227302 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-1df6a178-ad99-4249-89b1-a89943030f01 req-fbc65d45-30ca-4a2a-9a60-fa5b886bd3d8 service nova] Creating event network-vif-plugged:f9920718-056a-45cc-ae00-2c684b12e30c for instance ebb5a23e-99b6-483c-b332-5d855d82244d on hv-cinder-81045 May 24 10:22:58.232643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-1df6a178-ad99-4249-89b1-a89943030f01 req-fbc65d45-30ca-4a2a-9a60-fa5b886bd3d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 May 24 10:22:58.233275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 430/867] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:22:58.273573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:58.282333 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-57e901fb-f1e3-4377-b13b-07d4c509f8de tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.159585 May 24 10:22:58.282915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 438/868] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:58 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:22:59.140667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:59.141359 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:59.148642 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:59.149111 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:59.149866 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:59.150291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:59.277460 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:59.285179 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a284b2bd-5b66-4d26-a70d-d521ddb93d0b tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1358 microversion: 2.1 time: 0.148751 May 24 10:22:59.285755 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 431/869] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:59 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:22:59.298502 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:22:59.299107 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:22:59.305559 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:59.306009 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:59.306768 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:22:59.307204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:22:59.438719 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:22:59.446531 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d761d005-b4e6-4156-a3a9-e8ef406cb375 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.151772 May 24 10:22:59.447032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 439/870] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:22:59 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:00.302884 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:00.303516 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:00.309873 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.313046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.313046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.313046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.437799 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:00.445812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ff2ec494-729f-44e0-93b4-4cdb65059057 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1547 microversion: 2.1 time: 0.147020 May 24 10:23:00.446373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 432/871] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:00 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1547 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:00.462773 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:00.463056 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:00.463493 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:00.463645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:00.469778 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.469940 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.470269 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.470423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.471032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.471329 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.471460 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.471863 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.490694 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=100 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:00.663300 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:00.667932 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:00.670931 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4908e880-9749-41e5-bc06-6ed588ea2c96 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1547 microversion: 2.1 time: 0.212212 May 24 10:23:00.671509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 433/872] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:00 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1547 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:00.676235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a7b84376-b9bc-4ff7-a5b2-94fdf9043581 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.217412 May 24 10:23:00.676893 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 440/873] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:00 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:00.686719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:00.690086 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:00.690840 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Searching by: {'deleted': False, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e'} {{(pid=118131) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 24 10:23:00.698011 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.698461 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.699254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:00.699690 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:00.791480 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.multi_cell_list [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118131) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 24 10:23:01.049453 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b2b83d54-07f2-42d5-9fb6-0d32a89e4619 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.366266 May 24 10:23:01.050034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 434/874] 10.222.0.44 () {58 vars in 1124 bytes} [Tue May 24 10:23:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:01.060261 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:01.060861 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:01.066802 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.067245 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.068033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.068954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.197270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:01.204617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-90f5161f-addf-479b-b1c7-b12853605759 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1547 microversion: 2.1 time: 0.148188 May 24 10:23:01.205175 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 441/875] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:01 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:01.236930 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-20c36ade-6617-45b7-97de-88ca513e3635 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:01.239090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-20c36ade-6617-45b7-97de-88ca513e3635 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:01.244095 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20c36ade-6617-45b7-97de-88ca513e3635 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.244554 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20c36ade-6617-45b7-97de-88ca513e3635 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.245324 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20c36ade-6617-45b7-97de-88ca513e3635 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.245809 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-20c36ade-6617-45b7-97de-88ca513e3635 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.274654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-20c36ade-6617-45b7-97de-88ca513e3635 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments/99c50055-d2c9-4b3d-85a4-852f4c521b83" status: 200 len: 194 microversion: 2.20 time: 0.041738 May 24 10:23:01.275243 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 435/876] 10.222.0.44 () {60 vars in 1453 bytes} [Tue May 24 10:23:01 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments/99c50055-d2c9-4b3d-85a4-852f4c521b83 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:23:01.338542 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:01.339023 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:01.344937 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.347885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.347885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.347885 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.421367 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:01.424864 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lazy-loading 'services' on Instance uuid fe007745-7114-45bd-beef-67cbecf48624 {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:23:01.670631 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cd80b6ae-d74a-4ab2-b8e2-67c9122781ef tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments/99c50055-d2c9-4b3d-85a4-852f4c521b83" status: 202 len: 0 microversion: 2.20 time: 0.336390 May 24 10:23:01.671267 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 442/877] 10.222.0.44 () {60 vars in 1456 bytes} [Tue May 24 10:23:01 2022] DELETE /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments/99c50055-d2c9-4b3d-85a4-852f4c521b83 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:23:01.679666 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a369541e-3602-4064-81e9-372e87b69efc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:01.680660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a369541e-3602-4064-81e9-372e87b69efc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:01.686856 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369541e-3602-4064-81e9-372e87b69efc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.687328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369541e-3602-4064-81e9-372e87b69efc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.688118 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369541e-3602-4064-81e9-372e87b69efc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.688562 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a369541e-3602-4064-81e9-372e87b69efc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.695028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:01.697732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:01.702711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.703153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.704007 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:01.704424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:01.721142 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a369541e-3602-4064-81e9-372e87b69efc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045389 May 24 10:23:01.721698 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 436/878] 10.222.0.44 () {60 vars in 1342 bytes} [Tue May 24 10:23:01 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:23:01.840786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:01.848717 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-7d8a31f5-89f5-427b-b369-473f3a639e4e tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.158749 May 24 10:23:01.851828 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 443/879] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:01 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:02.732660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a81e587b-2803-4991-ad09-2589ce961051 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:02.733477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a81e587b-2803-4991-ad09-2589ce961051 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:02.740287 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a81e587b-2803-4991-ad09-2589ce961051 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:02.740826 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a81e587b-2803-4991-ad09-2589ce961051 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:02.741584 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a81e587b-2803-4991-ad09-2589ce961051 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:02.742017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a81e587b-2803-4991-ad09-2589ce961051 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:02.770246 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a81e587b-2803-4991-ad09-2589ce961051 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041770 May 24 10:23:02.770783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 437/880] 10.222.0.44 () {60 vars in 1342 bytes} [Tue May 24 10:23:02 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:23:02.865377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:02.866032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:02.873083 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:02.876887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:02.876887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:02.876887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:03.013988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:03.022509 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-51e6e855-6d50-4ab1-83c4-622d3203ff01 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.160204 May 24 10:23:03.023908 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 444/881] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:02 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:03.097605 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-191faf75-8faa-44b8-ac34-d8d9ca6233ec tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dafc8ad-136d-46bd-ab7b-1f67b84341b6"}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:03.098659 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-191faf75-8faa-44b8-ac34-d8d9ca6233ec tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:03.105208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-191faf75-8faa-44b8-ac34-d8d9ca6233ec tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:03.105653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-191faf75-8faa-44b8-ac34-d8d9ca6233ec tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:03.106421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-191faf75-8faa-44b8-ac34-d8d9ca6233ec tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:03.106857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-191faf75-8faa-44b8-ac34-d8d9ca6233ec tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:03.782224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bba36dd7-03a4-44e5-862b-9446c7573938 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:03.783194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bba36dd7-03a4-44e5-862b-9446c7573938 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:03.789481 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bba36dd7-03a4-44e5-862b-9446c7573938 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:03.789932 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bba36dd7-03a4-44e5-862b-9446c7573938 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:03.790764 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bba36dd7-03a4-44e5-862b-9446c7573938 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:03.791271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bba36dd7-03a4-44e5-862b-9446c7573938 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:03.820780 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bba36dd7-03a4-44e5-862b-9446c7573938 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041486 May 24 10:23:03.821230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 445/882] 10.222.0.44 () {60 vars in 1342 bytes} [Tue May 24 10:23:03 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:23:03.843551 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-191faf75-8faa-44b8-ac34-d8d9ca6233ec tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749658 May 24 10:23:03.844347 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 438/883] 10.222.0.44 () {60 vars in 1322 bytes} [Tue May 24 10:23:03 2022] POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:03.880840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:03.881353 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:03.895210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:03.895210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:03.895210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:03.895210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:03.923783 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:23:04.039576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:04.040686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:04.047076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:04.047524 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:04.048331 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:04.048768 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:04.186977 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:04.195124 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4c893574-268d-46fe-a8f7-af04b52655bd tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.159744 May 24 10:23:04.197253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9b178572-a427-4623-81d8-d13732f7cf82 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 204 len: 0 microversion: 2.20 time: 0.320069 May 24 10:23:04.198247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 446/884] 10.222.0.44 () {60 vars in 1279 bytes} [Tue May 24 10:23:03 2022] DELETE /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 10:23:04.205152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 439/885] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:04 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:23:04.208840 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:04.209881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:04.217177 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:04.217627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:04.218394 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:04.218824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:04.348849 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:04.357373 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:04.358863 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:04.360092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9629dcda-9fe8-4722-9751-51f69d6e9099 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.155611 May 24 10:23:04.360841 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 447/886] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:04 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:23:05.212443 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:05.212987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:05.219435 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:05.219918 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:05.220681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:05.221119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:05.350722 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:05.358938 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-333a4f9b-4b88-40b4-b12a-9b62878bf028 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.150955 May 24 10:23:05.370661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 440/887] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:05 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:05.378567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:05.379166 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:05.386216 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:05.386659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:05.387428 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:05.387919 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:05.512953 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:05.520811 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:05.522304 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:05.523732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-741e7b11-25c8-4c9a-a991-76f44910c9f7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.149024 May 24 10:23:05.524303 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 448/888] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:05 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:06.248407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-efb4c633-b25d-4997-a49a-4b9f9ccd38d3 req-3ccae222-32ce-45f2-b4e9-e6da234204db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b", "name": "network-vif-plugged", "status": "completed", "tag": "2a0b8e37-c6df-4421-9de0-035e1f941fd5"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:06.258345 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-efb4c633-b25d-4997-a49a-4b9f9ccd38d3 req-3ccae222-32ce-45f2-b4e9-e6da234204db service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:06.258918 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-efb4c633-b25d-4997-a49a-4b9f9ccd38d3 req-3ccae222-32ce-45f2-b4e9-e6da234204db service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:06.270792 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-efb4c633-b25d-4997-a49a-4b9f9ccd38d3 req-3ccae222-32ce-45f2-b4e9-e6da234204db service nova] Creating event network-vif-plugged:2a0b8e37-c6df-4421-9de0-035e1f941fd5 for instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b on hv-cinder-81045 May 24 10:23:06.276343 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-efb4c633-b25d-4997-a49a-4b9f9ccd38d3 req-3ccae222-32ce-45f2-b4e9-e6da234204db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031932 May 24 10:23:06.277134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 441/889] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:06.387042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:06.387835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:06.395685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:06.395685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:06.395685 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:06.396350 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:06.542780 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:06.543469 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:06.549714 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:06.550167 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:06.550925 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:06.551357 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:06.682745 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:06.691113 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-48bdc57b-2b05-439b-a59a-ca6bf74dc54f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.308928 May 24 10:23:06.700962 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 449/890] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:06 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:06.789323 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:06.797254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:06.798752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:06.799933 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-adc4b464-0177-4d9e-958a-33774ca6cb10 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1723 microversion: 2.20 time: 0.262007 May 24 10:23:06.800489 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 442/891] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:06 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:23:07.220658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-6b62970c-dd05-419b-bdea-61a1c26adf0b req-1216c4fb-e23c-4df8-b710-7feef56112e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe007745-7114-45bd-beef-67cbecf48624", "name": "network-vif-deleted", "tag": "a2beb885-96ae-4021-a2ba-85363ba17a9f"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:07.228757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-6b62970c-dd05-419b-bdea-61a1c26adf0b req-1216c4fb-e23c-4df8-b710-7feef56112e1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:07.229300 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-6b62970c-dd05-419b-bdea-61a1c26adf0b req-1216c4fb-e23c-4df8-b710-7feef56112e1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:07.240196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-6b62970c-dd05-419b-bdea-61a1c26adf0b req-1216c4fb-e23c-4df8-b710-7feef56112e1 service nova] Creating event network-vif-deleted:a2beb885-96ae-4021-a2ba-85363ba17a9f for instance fe007745-7114-45bd-beef-67cbecf48624 on hv-cinder-81045 May 24 10:23:07.245858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-6b62970c-dd05-419b-bdea-61a1c26adf0b req-1216c4fb-e23c-4df8-b710-7feef56112e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029156 May 24 10:23:07.246450 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 450/892] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:07.707823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:07.708646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:07.711975 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:07.717044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:07.717497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:07.718418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:07.718984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:07.824158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:07.824992 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:07.829165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:07.833212 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:07.833867 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:07.834856 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:07.835653 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:07.860220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:07.868874 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-06cde08d-43cd-443b-b744-5c0eef722702 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1260 microversion: 2.1 time: 0.164990 May 24 10:23:07.869707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 443/893] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:07 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:07.878155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:07.878155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:07.878155 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lazy-loading 'fault' on Instance uuid fe007745-7114-45bd-beef-67cbecf48624 {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:23:07.918381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:07.928139 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:07.930106 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:07.931216 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-45ad8986-7870-4bbe-9839-b8c57f7f827f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 200 len: 1371 microversion: 2.20 time: 0.112173 May 24 10:23:07.931774 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 451/894] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:07 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:08.893013 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:08.893626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:08.900136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:08.900590 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:08.901376 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:08.901816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:08.949980 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:08.950610 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:08.958119 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:08.958574 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:08.959355 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:08.959811 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:08.973964 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] HTTP exception thrown: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Request method failure captured: May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 HTTP/1.1 May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLFkXLABF2eAvvdQ6nKhcWyXCAd88JniLYIlk_u82OMj4V3AV6sGstiTUQhk7H85yuABYeuKPmSMTX1IHQXgKdyGCeMtHH8ZapRm7oy2H9ig500bUi6t7JzT95JYvKFLEQ632zwux_INrCn2Pi5NCg-lt7h4IGxfKJnMbnhGD3NkFzs May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Openstack-Nova-Api-Version: 2.20 May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f868bceb050645bea79affcb406f94d1 May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:23:08.975636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f868bceb050645bea79affcb406f94d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f868bceb050645bea79affcb406f94d1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f868bceb050645bea79affcb406f94d1 May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 4985774959804070b1d86f7e47b02473 May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:23:08.977770 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'fe007745-7114-45bd-beef-67cbecf48624'} May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:23:08.978638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:23:08.980376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:23:08.981865 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Returning 404 to user: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:23:08.981865 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-196e3099-db92-42b0-8fb8-f4381fe72af8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 404 len: 111 microversion: 2.20 time: 0.031389 May 24 10:23:08.981865 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 452/895] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:08 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 24 10:23:08.986692 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b85138af-1f6a-42ba-b6e5-d717bf94ee00 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '.version_select at 0x7ff6400251f0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:09.040459 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:09.047953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-66aa3566-cfcb-476f-a30b-46bbbf79a41c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1444 microversion: 2.1 time: 0.159117 May 24 10:23:09.050877 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 444/896] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:08 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:09.064729 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:09.065327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:09.071425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:09.071909 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:09.072667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:09.073101 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:09.074775 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b85138af-1f6a-42ba-b6e5-d717bf94ee00 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299776579" status: 204 len: 0 microversion: 2.20 time: 0.091789 May 24 10:23:09.075370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 453/897] 10.222.0.44 () {60 vars in 1258 bytes} [Tue May 24 10:23:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299776579 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 10:23:09.274035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:09.281469 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4b938a36-d406-4a22-845c-f4885c3dc647 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1444 microversion: 2.1 time: 0.220306 May 24 10:23:09.282034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 445/898] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:09 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1444 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:23:09.928219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2031b6a9-05a0-4710-816c-17a0f5e019d7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'create', calling method: .version_select at 0x7ff640012d30>, body: {"keypair": {"name": "tempest-keypair-1392822746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVlHqZ9GlLbZPQoN7QBRh4OD39JXfUYExbCWuwkanDwdlhA1giftBHztp7/xOW9VK1L6XeVVBzSOy9U4alpEiQy33TyrS1bFwCwMM52i0EX1AW+d/vV0jAxXKCqmyI9Sg=="}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:09.947354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-2031b6a9-05a0-4710-816c-17a0f5e019d7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for project f868bceb050645bea79affcb406f94d1. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:23:09.951258 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-2031b6a9-05a0-4710-816c-17a0f5e019d7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for user 4985774959804070b1d86f7e47b02473 and project f868bceb050645bea79affcb406f94d1. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:23:10.061316 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2031b6a9-05a0-4710-816c-17a0f5e019d7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.137289 May 24 10:23:10.062019 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 454/899] 10.222.0.44 () {62 vars in 1199 bytes} [Tue May 24 10:23:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 24 10:23:11.334734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-bd720dbb-94a7-4179-b3b0-dae5d581fded req-cb97c809-3119-4f0d-af9c-5d9181206e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b", "tag": "2a0b8e37-c6df-4421-9de0-035e1f941fd5"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:11.342810 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:11.347322 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bd720dbb-94a7-4179-b3b0-dae5d581fded req-cb97c809-3119-4f0d-af9c-5d9181206e99 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:11.348074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-bd720dbb-94a7-4179-b3b0-dae5d581fded req-cb97c809-3119-4f0d-af9c-5d9181206e99 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:11.363591 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-bd720dbb-94a7-4179-b3b0-dae5d581fded req-cb97c809-3119-4f0d-af9c-5d9181206e99 service nova] Creating event network-changed:2a0b8e37-c6df-4421-9de0-035e1f941fd5 for instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b on hv-cinder-81045 May 24 10:23:11.369209 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-bd720dbb-94a7-4179-b3b0-dae5d581fded req-cb97c809-3119-4f0d-af9c-5d9181206e99 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038475 May 24 10:23:11.369820 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 446/900] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:12.490074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:12.490678 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:12.497971 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:12.498418 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:12.499190 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:12.499630 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:12.639821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:12.647962 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b31a90f9-2ca9-469b-91f9-5d997a7d2869 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1593 microversion: 2.1 time: 0.161657 May 24 10:23:12.648512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 455/901] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:12 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:12.705104 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-705776649", "imageRef": "46bdecf4-933c-4473-aa66-aabaadc1cc6d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b5f19b2d-98eb-4516-aad1-c4077fe39d86"}], "security_groups": [{"name": "tempest-securitygroup--15874713"}], "key_name": "tempest-keypair-1392822746", "user_data": "}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:12.810291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] validate_networks() for [('b5f19b2d-98eb-4516-aad1-c4077fe39d86', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:23:13.659078 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:23:13.659821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:23:13.660329 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:23:13.660734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:23:13.661139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:23:13.670474 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:13.673719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:13.673719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:13.673719 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:13.688868 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for project f868bceb050645bea79affcb406f94d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:23:13.692731 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Getting quotas for user 4985774959804070b1d86f7e47b02473 and project f868bceb050645bea79affcb406f94d1. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:23:13.708062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:23:13.708062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='46bdecf4-933c-4473-aa66-aabaadc1cc6d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:23:13.878408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ae697b29-bc5b-432f-8aa0-a4c65c45ca3e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.179623 May 24 10:23:13.879046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 447/902] 10.222.0.44 () {62 vars in 1187 bytes} [Tue May 24 10:23:12 2022] POST /compute/v2.1/servers => generated 400 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 24 10:23:13.889915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-941d9698-c024-49ee-9944-9bf58d79577a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:13.890706 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-941d9698-c024-49ee-9944-9bf58d79577a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:13.965923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-941d9698-c024-49ee-9944-9bf58d79577a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:13.973948 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-941d9698-c024-49ee-9944-9bf58d79577a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:13.984915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-941d9698-c024-49ee-9944-9bf58d79577a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:13.986336 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-941d9698-c024-49ee-9944-9bf58d79577a tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1281 microversion: 2.20 time: 0.100747 May 24 10:23:13.986904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 456/903] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:13 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1281 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:15.005403 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:15.006220 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:15.013721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:15.014400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:15.015176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:15.015687 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:15.081980 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:15.094966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:15.094966 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:15.095386 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d014f645-19b0-4f0f-b513-3f71617d72f8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1285 microversion: 2.20 time: 0.094289 May 24 10:23:15.097664 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 448/904] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:14 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:23:15.236414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-861e4aeb-f281-419a-9bd4-a2b0c205df0a req-ab777d9a-cbab-4c5e-bf57-0157bb0095e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb5a23e-99b6-483c-b332-5d855d82244d", "tag": "f9920718-056a-45cc-ae00-2c684b12e30c"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:15.248725 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-861e4aeb-f281-419a-9bd4-a2b0c205df0a req-ab777d9a-cbab-4c5e-bf57-0157bb0095e1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:15.249534 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-861e4aeb-f281-419a-9bd4-a2b0c205df0a req-ab777d9a-cbab-4c5e-bf57-0157bb0095e1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:15.260573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-861e4aeb-f281-419a-9bd4-a2b0c205df0a req-ab777d9a-cbab-4c5e-bf57-0157bb0095e1 service nova] Creating event network-changed:f9920718-056a-45cc-ae00-2c684b12e30c for instance ebb5a23e-99b6-483c-b332-5d855d82244d on hv-cinder-81045 May 24 10:23:15.265697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-861e4aeb-f281-419a-9bd4-a2b0c205df0a req-ab777d9a-cbab-4c5e-bf57-0157bb0095e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033209 May 24 10:23:15.266356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 457/905] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:16.113554 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:16.115628 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:16.128261 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:16.130243 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:16.133726 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:16.134674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:16.214076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:16.222509 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:16.224455 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:16.226239 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e97afafb-becd-43a8-9ea9-58dcad6089bd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1341 microversion: 2.20 time: 0.116654 May 24 10:23:16.227416 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 449/906] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:16 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1341 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:17.246408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:17.247097 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:17.253484 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:17.253964 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:17.254791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:17.255227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:17.395606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:17.403674 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:17.405198 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:17.406303 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-76ae730b-88b0-4ab1-83a1-e20a8a4e720d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.165305 May 24 10:23:17.406871 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 458/907] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:17 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:18.056626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-d1ce0d48-096f-44ee-835c-f245cd977a97 req-345bda32-a2b4-4b5f-b69b-6b0131de508f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b16a9a-c684-4154-b1d6-5f8530007d73", "tag": "9da6301e-3531-43c6-8a9d-e3c9c4997951"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:18.065850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d1ce0d48-096f-44ee-835c-f245cd977a97 req-345bda32-a2b4-4b5f-b69b-6b0131de508f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:18.066580 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d1ce0d48-096f-44ee-835c-f245cd977a97 req-345bda32-a2b4-4b5f-b69b-6b0131de508f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:18.079696 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-d1ce0d48-096f-44ee-835c-f245cd977a97 req-345bda32-a2b4-4b5f-b69b-6b0131de508f service nova] Creating event network-changed:9da6301e-3531-43c6-8a9d-e3c9c4997951 for instance 09b16a9a-c684-4154-b1d6-5f8530007d73 on hv-cinder-81045 May 24 10:23:18.085877 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-d1ce0d48-096f-44ee-835c-f245cd977a97 req-345bda32-a2b4-4b5f-b69b-6b0131de508f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032650 May 24 10:23:18.086687 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 450/908] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:18.196455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-977586226"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:18.197253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:18.203596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:18.204077 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:18.205019 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:18.205455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:18.344994 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.network.security_group_api [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Adding security group 2e57c5b7-0fcf-49c7-b770-fc97943236d5 to port f9920718-056a-45cc-ae00-2c684b12e30c May 24 10:23:18.425365 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:18.426308 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:18.433334 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:18.433724 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:18.434487 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:18.434921 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:18.439310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:18.643246 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:18.652841 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:18.654605 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:18.655765 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e4783ab6-b7ea-4586-b739-babcd7bca459 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.234655 May 24 10:23:18.656400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 451/909] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:18 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:19.498961 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d3541535-5177-4581-be68-3b315ce1e72f tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/action" status: 202 len: 0 microversion: 2.1 time: 1.307162 May 24 10:23:19.500881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 459/910] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:23:18 2022] POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:23:19.514979 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:19.516438 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:19.523671 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-9752b0a6-21b8-4a49-b496-ae4ad0029c90 req-b65f358e-53e9-4b6d-9ed4-8b57a0f452c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb5a23e-99b6-483c-b332-5d855d82244d", "tag": "f9920718-056a-45cc-ae00-2c684b12e30c"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:19.535573 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:19.535573 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:19.535573 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:19.536031 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:19.543408 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-9752b0a6-21b8-4a49-b496-ae4ad0029c90 req-b65f358e-53e9-4b6d-9ed4-8b57a0f452c3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:19.543943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-9752b0a6-21b8-4a49-b496-ae4ad0029c90 req-b65f358e-53e9-4b6d-9ed4-8b57a0f452c3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:19.566972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-9752b0a6-21b8-4a49-b496-ae4ad0029c90 req-b65f358e-53e9-4b6d-9ed4-8b57a0f452c3 service nova] Creating event network-changed:f9920718-056a-45cc-ae00-2c684b12e30c for instance ebb5a23e-99b6-483c-b332-5d855d82244d on hv-cinder-81045 May 24 10:23:19.573974 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-9752b0a6-21b8-4a49-b496-ae4ad0029c90 req-b65f358e-53e9-4b6d-9ed4-8b57a0f452c3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064376 May 24 10:23:19.580549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 460/911] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:19.676421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:19.678887 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:19.687961 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:19.692374 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:19.693278 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:19.693711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:19.789493 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:19.799000 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8d824db5-7b50-4097-82f5-639df3fc1a14 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1758 microversion: 2.1 time: 0.293787 May 24 10:23:19.799581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 452/912] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:19 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1758 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:19.860322 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:19.869323 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:19.870813 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:19.871990 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8deea53e-2727-4afd-a0f6-180715250e35 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.201078 May 24 10:23:19.872525 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 461/913] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:19 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:23:20.890430 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:20.891042 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:20.898154 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:20.898708 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:20.899476 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:20.899947 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:21.026853 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:21.034588 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:21.036090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:21.037176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ae42215c-8583-4e36-ac18-cf653cbb16d5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.150658 May 24 10:23:21.037728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 453/914] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:20 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:22.055145 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:22.055773 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:22.062210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:22.062652 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:22.063403 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:22.063866 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:22.194637 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:22.198834 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:22.203710 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:22.205327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:22.206393 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-dcb8c7cc-b420-43f2-af0d-3ff1be1ad11f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.155422 May 24 10:23:22.206944 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 462/915] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:22 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:23.224479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:23.225082 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:23.231470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:23.231950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:23.232704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:23.233142 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:23.358100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:23.365830 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:23.368221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:23.369347 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e32a0201-4980-4cc3-8216-0d39947cb53b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.148732 May 24 10:23:23.369897 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 454/916] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:23 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:24.333427 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-399802d2-a6f4-4de4-9e61-3bf4f035de8f req-de3634d5-7afc-4372-b1bd-c0e21f6a68c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b16a9a-c684-4154-b1d6-5f8530007d73", "name": "network-vif-plugged", "status": "completed", "tag": "9da6301e-3531-43c6-8a9d-e3c9c4997951"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:24.338590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=6 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:24.344609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-399802d2-a6f4-4de4-9e61-3bf4f035de8f req-de3634d5-7afc-4372-b1bd-c0e21f6a68c1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:24.345044 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-399802d2-a6f4-4de4-9e61-3bf4f035de8f req-de3634d5-7afc-4372-b1bd-c0e21f6a68c1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:24.357259 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-399802d2-a6f4-4de4-9e61-3bf4f035de8f req-de3634d5-7afc-4372-b1bd-c0e21f6a68c1 service nova] Creating event network-vif-plugged:9da6301e-3531-43c6-8a9d-e3c9c4997951 for instance 09b16a9a-c684-4154-b1d6-5f8530007d73 on hv-cinder-81045 May 24 10:23:24.362071 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-399802d2-a6f4-4de4-9e61-3bf4f035de8f req-de3634d5-7afc-4372-b1bd-c0e21f6a68c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032673 May 24 10:23:24.362646 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 463/917] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:24.387514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:24.388169 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:24.389962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:24.390720 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:24.396003 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:24.396564 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:24.397300 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:24.397735 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:24.531912 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:24.540838 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:24.542277 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:24.543377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0a6a1d1d-412f-49ef-a02b-27b67f998e26 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.159868 May 24 10:23:24.543949 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 455/918] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:24 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:25.562674 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:25.563359 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:25.570172 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:25.570615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:25.571368 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:25.571830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:25.704724 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:25.712947 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:25.714430 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:25.715512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-57473593-2e74-4bcf-bea4-864425158ad7 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1405 microversion: 2.20 time: 0.158148 May 24 10:23:25.716184 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 464/919] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:25 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:26.733299 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:26.733903 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:26.742020 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:26.742462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:26.743219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:26.743648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:26.869673 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:26.877617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:26.879143 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:26.880336 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9d8ce5d7-416c-4687-8f75-f15aa9dffa7c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1597 microversion: 2.20 time: 0.150936 May 24 10:23:26.881355 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 456/920] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:23:26 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1597 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:23:26.898341 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e419d911-b990-4bfa-bef2-ea2f3bc41806 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:26.898899 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e419d911-b990-4bfa-bef2-ea2f3bc41806 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:26.905277 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e419d911-b990-4bfa-bef2-ea2f3bc41806 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:26.905718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e419d911-b990-4bfa-bef2-ea2f3bc41806 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:26.906478 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e419d911-b990-4bfa-bef2-ea2f3bc41806 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:26.906902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e419d911-b990-4bfa-bef2-ea2f3bc41806 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:26.983453 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e419d911-b990-4bfa-bef2-ea2f3bc41806 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088899 May 24 10:23:26.984088 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 465/921] 10.222.0.44 () {60 vars in 1315 bytes} [Tue May 24 10:23:26 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:23:28.191176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-b6c42b75-a9de-491b-b514-af3acc9cde1e req-e191cbff-ad7f-491f-bb85-4c8a538c434e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09b16a9a-c684-4154-b1d6-5f8530007d73", "tag": "9da6301e-3531-43c6-8a9d-e3c9c4997951"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:28.199650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b6c42b75-a9de-491b-b514-af3acc9cde1e req-e191cbff-ad7f-491f-bb85-4c8a538c434e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:28.200129 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-b6c42b75-a9de-491b-b514-af3acc9cde1e req-e191cbff-ad7f-491f-bb85-4c8a538c434e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:28.211878 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-b6c42b75-a9de-491b-b514-af3acc9cde1e req-e191cbff-ad7f-491f-bb85-4c8a538c434e service nova] Creating event network-changed:9da6301e-3531-43c6-8a9d-e3c9c4997951 for instance 09b16a9a-c684-4154-b1d6-5f8530007d73 on hv-cinder-81045 May 24 10:23:28.216881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-b6c42b75-a9de-491b-b514-af3acc9cde1e req-e191cbff-ad7f-491f-bb85-4c8a538c434e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029299 May 24 10:23:28.217562 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 457/922] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:23:33.626515 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a08ab557-9f54-400a-9cea-6f59dbe0dda0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:23:33.627444 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a08ab557-9f54-400a-9cea-6f59dbe0dda0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:33.634164 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a08ab557-9f54-400a-9cea-6f59dbe0dda0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:33.634605 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a08ab557-9f54-400a-9cea-6f59dbe0dda0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:33.635359 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a08ab557-9f54-400a-9cea-6f59dbe0dda0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:33.635786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a08ab557-9f54-400a-9cea-6f59dbe0dda0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:33.870390 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a08ab557-9f54-400a-9cea-6f59dbe0dda0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/action" status: 202 len: 0 microversion: 2.1 time: 0.248092 May 24 10:23:33.871050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 466/923] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:23:33 2022] POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:23:33.881784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:33.882429 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:33.889091 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:33.889533 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:33.890295 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:33.890728 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:34.035649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:34.044683 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ea011650-18e9-4779-90ba-96a1871a33e5 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1750 microversion: 2.1 time: 0.167140 May 24 10:23:34.045280 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 458/924] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:33 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:35.063599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:35.064327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:35.071284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:35.071732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:35.072520 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:35.072957 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:35.212716 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:35.220632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5a0cf8c1-f57b-423d-b530-7c54950e218d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.161856 May 24 10:23:35.221191 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 467/925] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:35 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:36.238452 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:36.239088 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:36.245714 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:36.247421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:36.247421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:36.247421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:36.390163 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:36.398533 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4bb0b1ea-8592-41e4-ba67-b7a358aeca1e tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.163989 May 24 10:23:36.399092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 459/926] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:36 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:37.415982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:37.416587 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:37.423173 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:37.423618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:37.424407 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:37.424839 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:37.564094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:37.572596 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9223e7e4-c416-4e5f-b9b0-a8a001f198b1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.160978 May 24 10:23:37.573161 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 468/927] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:37 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:38.590812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:38.591452 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:38.597972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:38.598417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:38.599172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:38.599604 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:38.745126 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:38.753187 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-599084df-7b0b-492b-ac46-e8cecb470eb2 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.166228 May 24 10:23:38.756173 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 460/928] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:38 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:39.771458 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:39.772096 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:39.775172 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:39.779967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:39.780420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:39.781187 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:39.781651 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:39.925064 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:39.933032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-9979bbdb-9f9f-4940-a8e5-96f1fc525975 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.165379 May 24 10:23:39.933594 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 469/929] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:39 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:40.950288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:40.950900 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:40.953306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:23:40.958027 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:40.958476 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:40.959235 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:40.959668 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:41.097258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:41.105643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5908669d-5cf6-47dc-80c0-cfc91085590c tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.159302 May 24 10:23:41.106210 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 461/930] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:40 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:42.122921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:42.123520 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:42.129957 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:42.130404 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:42.131159 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:42.131593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:42.275641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:42.283490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d6c67409-67a8-4183-8604-81e3adbd31b3 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.164419 May 24 10:23:42.284089 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 470/931] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:42 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:43.300951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:43.301558 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:43.308709 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:43.309172 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:43.309917 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:43.310350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:43.449159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:43.457100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-08c4ef43-31a9-4527-848b-65ab6d6ecb00 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.160027 May 24 10:23:43.457661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 462/932] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:43 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:44.474305 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:44.474908 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:44.481393 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:44.481843 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:44.482598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:44.483036 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:44.627114 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:44.635075 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-667fa804-ae2a-4092-aee6-c88028b5b111 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1755 microversion: 2.1 time: 0.164568 May 24 10:23:44.635638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 471/933] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:44 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:23:45.653055 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:23:45.653661 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:23:45.660248 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:45.660702 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:45.661465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:23:45.661905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:23:45.801598 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:23:45.809825 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d9dcaa91-535f-42ef-bba9-86501433e642 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1758 microversion: 2.1 time: 0.160662 May 24 10:23:45.810386 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 463/934] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:23:45 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:24:04.171333 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-15866298-cc1c-4c06-b1a4-287fb91ee445 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:04.171943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-15866298-cc1c-4c06-b1a4-287fb91ee445 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:04.174617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=5 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:04.175229 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:04.180202 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15866298-cc1c-4c06-b1a4-287fb91ee445 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:04.180654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15866298-cc1c-4c06-b1a4-287fb91ee445 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:04.181495 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15866298-cc1c-4c06-b1a4-287fb91ee445 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:04.181935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-15866298-cc1c-4c06-b1a4-287fb91ee445 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:04.205369 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-15866298-cc1c-4c06-b1a4-287fb91ee445 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/ips" status: 200 len: 152 microversion: 2.20 time: 0.037937 May 24 10:24:04.205921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 472/935] 10.222.0.44 () {60 vars in 1288 bytes} [Tue May 24 10:24:04 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:24:06.523613 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:06.524179 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:06.526568 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=5 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:06.527219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=72 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:06.532014 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:06.532458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:06.533218 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:06.533649 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:06.557010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lazy-loading 'flavor' on Instance uuid 09b16a9a-c684-4154-b1d6-5f8530007d73 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:24:07.117507 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1df01489-e6bd-4b8e-b360-acbb1b74eeea tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/action" status: 202 len: 0 microversion: 2.20 time: 0.597713 May 24 10:24:07.118075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 464/936] 10.222.0.44 () {62 vars in 1318 bytes} [Tue May 24 10:24:06 2022] POST /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:24:07.126386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:07.127002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:07.135881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:07.136337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:07.137116 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:07.137556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:07.267110 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:07.275979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:07.277517 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:07.278672 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-84a8daa9-277d-4fde-8690-1651f34cc273 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.156164 May 24 10:24:07.279217 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 473/937] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:07 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:08.297820 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:08.298540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:08.304850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:08.305296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:08.306782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:08.307217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:08.438352 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:08.446988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:08.448995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:08.449685 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a4125309-0b22-47a1-b554-653f6d188896 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.156717 May 24 10:24:08.450244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 465/938] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:08 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:09.469357 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:09.469983 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:09.476372 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:09.476812 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:09.477607 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:09.478128 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:09.601982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:09.610255 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:09.611737 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:09.612904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a5822c07-c272-4864-aa0b-6b02c4b3ac03 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.147543 May 24 10:24:09.613452 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 474/939] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:09 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:10.631445 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:10.632072 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:10.639139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:10.639583 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:10.640373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:10.640803 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:10.768734 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:10.776677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:10.778157 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:10.779302 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ce1b3c48-d6a6-47ec-b8bf-a8b5b32636e8 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.151748 May 24 10:24:10.779870 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 466/940] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:10 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:11.797472 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:11.798013 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:11.804465 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:11.804913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:11.806466 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:11.806924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:11.933073 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:11.940951 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:11.942437 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:11.943584 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0923a374-14c0-49f1-a8c6-47d2e397d396 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.150120 May 24 10:24:11.944179 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 475/941] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:11 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:24:12.961864 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:12.962467 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:12.968987 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:12.969431 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:12.970184 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:12.970613 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:13.100929 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:13.109498 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:13.110993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:13.112176 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7b258804-ca1e-4102-af21-70bda7e33185 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.154430 May 24 10:24:13.112739 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 467/942] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:12 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:14.131014 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:14.131523 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:14.138116 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:14.138557 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:14.139342 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:14.139768 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:14.264848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:14.272543 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:14.274056 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:14.275309 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-185d6d3f-be3b-46f4-9ee2-3d2bfb1669a9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.148332 May 24 10:24:14.275876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 476/943] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:14 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:15.293821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:15.294691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:15.301160 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:15.301644 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:15.302399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:15.302827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:15.429881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:15.438483 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:15.440010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:15.441180 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-678f8e09-3912-4b1f-941c-0250594fcc4c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.151896 May 24 10:24:15.441741 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 468/944] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:15 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:16.459846 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:16.460448 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:16.467717 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:16.468266 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:16.469914 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:16.469914 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:16.597950 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:16.606412 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:16.608220 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:16.609356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-08dd95cc-1def-4e8d-a211-74603fb8b43c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.153423 May 24 10:24:16.609907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 477/945] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:16 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:17.627514 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:17.629169 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:17.634797 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:17.635294 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:17.636078 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:17.636510 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:17.810799 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:17.818479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:17.820267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:17.821421 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-734546d0-6f52-4a51-a3a4-2c84db0b71a6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.197845 May 24 10:24:17.822201 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 469/946] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:17 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:18.089451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-977586226"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:18.090026 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:18.096431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:18.096881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:18.097627 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:18.098055 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:18.225341 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.network.security_group_api [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Removing security group 2e57c5b7-0fcf-49c7-b770-fc97943236d5 from port f9920718-056a-45cc-ae00-2c684b12e30c May 24 10:24:18.639659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cef0039d-a4f0-49c8-9e85-d0000846bcb4 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/action" status: 202 len: 0 microversion: 2.1 time: 0.554343 May 24 10:24:18.641560 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 478/947] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:24:18 2022] POST /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:24:18.649574 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-8ed29132-f83d-4d5b-90a9-2c7effce1a85 req-664718d4-ed2c-4a5c-8a95-276f109c14b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb5a23e-99b6-483c-b332-5d855d82244d", "tag": "f9920718-056a-45cc-ae00-2c684b12e30c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:18.663035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8ed29132-f83d-4d5b-90a9-2c7effce1a85 req-664718d4-ed2c-4a5c-8a95-276f109c14b9 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:18.663941 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-8ed29132-f83d-4d5b-90a9-2c7effce1a85 req-664718d4-ed2c-4a5c-8a95-276f109c14b9 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:18.679641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-8ed29132-f83d-4d5b-90a9-2c7effce1a85 req-664718d4-ed2c-4a5c-8a95-276f109c14b9 service nova] Creating event network-changed:f9920718-056a-45cc-ae00-2c684b12e30c for instance ebb5a23e-99b6-483c-b332-5d855d82244d on hv-cinder-81045 May 24 10:24:18.686656 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-8ed29132-f83d-4d5b-90a9-2c7effce1a85 req-664718d4-ed2c-4a5c-8a95-276f109c14b9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042839 May 24 10:24:18.687527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 470/948] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:24:18.842050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:18.843326 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:18.851426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:18.852195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:18.853337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:18.854035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:19.116891 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:19.126356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:19.127890 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:19.129133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-86e8d365-4652-48f4-a082-dc3010c0d91d tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.293212 May 24 10:24:19.130151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 479/949] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:18 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:19.878923 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:19.884275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:19.886595 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:19.887051 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:19.887845 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:19.888289 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:19.970148 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lazy-loading 'services' on Instance uuid ebb5a23e-99b6-483c-b332-5d855d82244d {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:24:20.147636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:20.148356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:20.156246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:20.156699 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:20.157461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:20.157896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:20.181623 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2679545f-4011-4aea-be3b-81dc6b305bf1 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments/4dafc8ad-136d-46bd-ab7b-1f67b84341b6" status: 202 len: 0 microversion: 2.1 time: 0.306861 May 24 10:24:20.182446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 471/950] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:24:19 2022] DELETE /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments/4dafc8ad-136d-46bd-ab7b-1f67b84341b6 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 24 10:24:20.195457 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-468b12db-5056-46b5-8e6f-a1beb8f865e0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:20.196874 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-468b12db-5056-46b5-8e6f-a1beb8f865e0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:20.205458 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-468b12db-5056-46b5-8e6f-a1beb8f865e0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:20.206338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-468b12db-5056-46b5-8e6f-a1beb8f865e0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:20.207416 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-468b12db-5056-46b5-8e6f-a1beb8f865e0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:20.208624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-468b12db-5056-46b5-8e6f-a1beb8f865e0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:20.243826 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-468b12db-5056-46b5-8e6f-a1beb8f865e0 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056738 May 24 10:24:20.245232 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 472/951] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:24:20 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:24:20.317416 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:20.332072 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:20.333630 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:20.335060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f010f482-371b-44d1-a3e4-e3d4805686e9 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.191319 May 24 10:24:20.336461 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 480/952] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:20 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:24:20.707387 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-d624a423-cfa0-4e0f-b51a-77328ba51eed req-21723efd-e036-4dbc-b1c1-e2e0dcb64c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb5a23e-99b6-483c-b332-5d855d82244d", "tag": "f9920718-056a-45cc-ae00-2c684b12e30c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:20.716267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d624a423-cfa0-4e0f-b51a-77328ba51eed req-21723efd-e036-4dbc-b1c1-e2e0dcb64c7e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:20.716707 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-d624a423-cfa0-4e0f-b51a-77328ba51eed req-21723efd-e036-4dbc-b1c1-e2e0dcb64c7e service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:20.727875 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-d624a423-cfa0-4e0f-b51a-77328ba51eed req-21723efd-e036-4dbc-b1c1-e2e0dcb64c7e service nova] Creating event network-changed:f9920718-056a-45cc-ae00-2c684b12e30c for instance ebb5a23e-99b6-483c-b332-5d855d82244d on hv-cinder-81045 May 24 10:24:20.732848 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-d624a423-cfa0-4e0f-b51a-77328ba51eed req-21723efd-e036-4dbc-b1c1-e2e0dcb64c7e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029099 May 24 10:24:20.733459 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 473/953] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:24:21.255990 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5a4bc7fa-a4a9-42ed-b58c-a4827c0e55f7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:21.258248 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5a4bc7fa-a4a9-42ed-b58c-a4827c0e55f7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:21.264878 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4bc7fa-a4a9-42ed-b58c-a4827c0e55f7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:21.266099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4bc7fa-a4a9-42ed-b58c-a4827c0e55f7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:21.266540 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4bc7fa-a4a9-42ed-b58c-a4827c0e55f7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:21.266979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5a4bc7fa-a4a9-42ed-b58c-a4827c0e55f7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:21.297793 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5a4bc7fa-a4a9-42ed-b58c-a4827c0e55f7 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045783 May 24 10:24:21.298377 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 481/954] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:24:21 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:24:21.355996 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:21.356606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:21.362792 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:21.363379 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:21.364030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:21.364537 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:21.497069 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:21.506084 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:21.507601 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:21.508946 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-233c1c5b-f069-44d6-81d7-8c1dbee4a7c3 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.158235 May 24 10:24:21.510218 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 474/955] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:21 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:22.310301 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d90848fa-60c9-4240-bdfa-9711291138da tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:22.311243 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d90848fa-60c9-4240-bdfa-9711291138da tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:22.317747 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d90848fa-60c9-4240-bdfa-9711291138da tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:22.318190 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d90848fa-60c9-4240-bdfa-9711291138da tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:22.318941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d90848fa-60c9-4240-bdfa-9711291138da tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:22.319367 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d90848fa-60c9-4240-bdfa-9711291138da tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:22.347556 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d90848fa-60c9-4240-bdfa-9711291138da tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041681 May 24 10:24:22.348145 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 482/956] 10.222.0.44 () {58 vars in 1301 bytes} [Tue May 24 10:24:22 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 24 10:24:22.358388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:22.358887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:22.365385 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:22.366014 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:22.366813 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:22.367244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:22.444205 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] HTTP exception thrown: Instance ebb5a23e-99b6-483c-b332-5d855d82244d is not attached to volume 4dafc8ad-136d-46bd-ab7b-1f67b84341b6 May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Request method failure captured: May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments/4dafc8ad-136d-46bd-ab7b-1f67b84341b6 HTTP/1.1 May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLHWCudil6bmKV4qXJUpZrFIAFUI0CLe8J3mTDF9Bk8HtGjp9dfX4I53-T7msz-yjuEr7e-HzxZgfRI1A1Dm2J5_BvqUtoDyeWkxE8ZNECFoi7aX7NQXPf6hf4MIoMd18pIfH1W4VuYqsraGnlxMt6OK4vvd7ni3ZJN6EggVXtnSad8 May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: f4c9c14cf4bc42878a2f63a0ffa2762e May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-TestMinimumBasicScenario-1960487919 May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:24:22.446638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4c9c14cf4bc42878a2f63a0ffa2762e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4c9c14cf4bc42878a2f63a0ffa2762e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4c9c14cf4bc42878a2f63a0ffa2762e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4c9c14cf4bc42878a2f63a0ffa2762e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-TestMinimumBasicScenario-1960487919 May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: f4c9c14cf4bc42878a2f63a0ffa2762e May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1960487919 May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-TestMinimumBasicScenario-1960487919-project May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: c793637b93de4def9e2dd271c96f26a2 May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-TestMinimumBasicScenario-1960487919-project May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:24:22.448715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance ebb5a23e-99b6-483c-b332-5d855d82244d is not attached to volume 4dafc8ad-136d-46bd-ab7b-1f67b84341b6 May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'server_id': 'ebb5a23e-99b6-483c-b332-5d855d82244d', 'id': '4dafc8ad-136d-46bd-ab7b-1f67b84341b6'} May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4dafc8ad-136d-46bd-ab7b-1f67b84341b6. May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:24:22.450146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb5a23e-99b6-483c-b332-5d855d82244d is not attached to volume 4dafc8ad-136d-46bd-ab7b-1f67b84341b6 May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb5a23e-99b6-483c-b332-5d855d82244d is not attached to volume 4dafc8ad-136d-46bd-ab7b-1f67b84341b6 May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:24:22.451715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Returning 404 to user: Instance ebb5a23e-99b6-483c-b332-5d855d82244d is not attached to volume 4dafc8ad-136d-46bd-ab7b-1f67b84341b6 {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:24:22.452905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-4a993543-df33-4007-a669-bd0e35d5c858 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments/4dafc8ad-136d-46bd-ab7b-1f67b84341b6" status: 404 len: 154 microversion: 2.1 time: 0.093715 May 24 10:24:22.452905 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 475/957] 10.222.0.44 () {58 vars in 1415 bytes} [Tue May 24 10:24:22 2022] DELETE /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d/os-volume_attachments/4dafc8ad-136d-46bd-ab7b-1f67b84341b6 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:24:22.527647 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:22.528318 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:22.534277 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:22.534728 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:22.535490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:22.535959 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:22.721606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:22.729987 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:22.731733 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:22.732912 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1ad585a5-da88-447c-8625-9b779c215b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.209872 May 24 10:24:22.733459 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 483/958] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:22 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:23.731190 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:23.731708 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:23.738094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:23.738533 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:23.739288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:23.739715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:23.751160 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:23.751759 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:23.758128 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:23.758565 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:23.759315 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:23.760050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:23.764805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:24:23.885619 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:23.893834 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:23.895339 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:23.896624 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4b8c0f16-8887-4777-9ef3-dcd707ff04ee tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1743 microversion: 2.20 time: 0.149384 May 24 10:24:23.897270 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 484/959] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:23 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:24:24.037951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-d2ca3794-3b57-436f-b031-006eae3b0551 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 204 len: 0 microversion: 2.1 time: 0.310899 May 24 10:24:24.038462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 476/960] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:24:23 2022] DELETE /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:24:24.047603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:24.048238 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:24.055133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:24.055579 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:24.056425 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:24.056858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:24.184626 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:24.192190 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-62450367-9773-4ea1-b46a-772da464c31d tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1553 microversion: 2.1 time: 0.148317 May 24 10:24:24.192776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 485/961] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:24:24 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:24:24.916382 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:24.917174 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:24.923572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:24.924124 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:24.924926 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:24.925363 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:24.944254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:25.051924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:25.060323 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:25.061805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:25.062952 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f7443391-f68f-4044-a71f-a01b8d688400 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1743 microversion: 2.20 time: 0.150979 May 24 10:24:25.063503 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 477/962] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:24 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:25.213591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:25.213591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:25.217561 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:25.218032 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:25.218841 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:25.219272 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:25.348306 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:25.356370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f1b82f28-12ad-4b56-902c-59de67b1be01 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1553 microversion: 2.1 time: 0.150664 May 24 10:24:25.356926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 486/963] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:24:25 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:24:26.081010 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:26.081625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:26.088970 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:26.090111 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:26.091096 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:26.091541 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:26.222991 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:26.231957 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:26.233522 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:26.234675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-eed10bb6-bc57-4ca9-a2d8-bd4d974c2e1c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.157695 May 24 10:24:26.235233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 478/964] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:26 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:26.372955 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:26.373563 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:26.380185 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:26.380641 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:26.381421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:26.381845 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:26.445890 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:26.454465 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0bb6dfae-6f44-44b4-8f42-2ba094aae92a tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1511 microversion: 2.1 time: 0.085328 May 24 10:24:26.455584 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 487/965] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:24:26 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:24:26.551744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-f2e315ff-0ab4-46da-89ed-f0c594e6f8e8 req-04edab89-fc03-4dd7-af18-12f0a1928b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb5a23e-99b6-483c-b332-5d855d82244d", "name": "network-vif-deleted", "tag": "f9920718-056a-45cc-ae00-2c684b12e30c"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:26.568723 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f2e315ff-0ab4-46da-89ed-f0c594e6f8e8 req-04edab89-fc03-4dd7-af18-12f0a1928b5f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:26.569188 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f2e315ff-0ab4-46da-89ed-f0c594e6f8e8 req-04edab89-fc03-4dd7-af18-12f0a1928b5f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:26.582060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-f2e315ff-0ab4-46da-89ed-f0c594e6f8e8 req-04edab89-fc03-4dd7-af18-12f0a1928b5f service nova] Creating event network-vif-deleted:f9920718-056a-45cc-ae00-2c684b12e30c for instance ebb5a23e-99b6-483c-b332-5d855d82244d on hv-cinder-81045 May 24 10:24:26.588338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-f2e315ff-0ab4-46da-89ed-f0c594e6f8e8 req-04edab89-fc03-4dd7-af18-12f0a1928b5f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040057 May 24 10:24:26.588946 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 479/966] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:24:26.626996 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-8fc5b733-8401-4b01-86f4-5ddeee7b1527 req-81c6562c-47c2-482c-b4b2-4648968c2ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b16a9a-c684-4154-b1d6-5f8530007d73", "name": "network-vif-plugged", "status": "completed", "tag": "9da6301e-3531-43c6-8a9d-e3c9c4997951"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:26.635843 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-8fc5b733-8401-4b01-86f4-5ddeee7b1527 req-81c6562c-47c2-482c-b4b2-4648968c2ef6 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:26.636300 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-8fc5b733-8401-4b01-86f4-5ddeee7b1527 req-81c6562c-47c2-482c-b4b2-4648968c2ef6 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:26.652065 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-8fc5b733-8401-4b01-86f4-5ddeee7b1527 req-81c6562c-47c2-482c-b4b2-4648968c2ef6 service nova] Creating event network-vif-plugged:9da6301e-3531-43c6-8a9d-e3c9c4997951 for instance 09b16a9a-c684-4154-b1d6-5f8530007d73 on hv-cinder-81045 May 24 10:24:26.654628 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-8fc5b733-8401-4b01-86f4-5ddeee7b1527 req-81c6562c-47c2-482c-b4b2-4648968c2ef6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031345 May 24 10:24:26.655521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 488/967] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:24:27.254794 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:27.259003 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:27.265267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:27.265968 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:27.266915 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:27.267505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:27.426196 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:27.440507 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:27.442101 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:27.443538 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-54b0f217-bfbf-4533-b7df-ff1673653727 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.193719 May 24 10:24:27.444195 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 480/968] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:27 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:27.473224 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:27.474370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:27.487663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:27.488211 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:27.490930 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:27.490930 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:27.534737 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:27.535522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:27.536202 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lazy-loading 'fault' on Instance uuid ebb5a23e-99b6-483c-b332-5d855d82244d {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:24:27.539482 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=100 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:27.586593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c793637b93de4def9e2dd271c96f26a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4c9c14cf4bc42878a2f63a0ffa2762e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:27.596131 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-26c1a1d5-cd65-4748-825d-5ce74e5f9187 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 200 len: 1348 microversion: 2.1 time: 0.127256 May 24 10:24:27.596708 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 489/969] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:24:27 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 1348 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:24:28.462655 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:28.463258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:28.470328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:28.471015 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:28.472019 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:28.472617 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:28.617213 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:28.618456 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] [instance: ebb5a23e-99b6-483c-b332-5d855d82244d] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:28.626025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:28.638779 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:28.639718 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:28.640988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:28.643385 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:28.649019 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:28.651254 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:28.653258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-da93bf09-1cef-47fb-a100-94401ab24084 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.194595 May 24 10:24:28.654035 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 481/970] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:28 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:28.663639 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] HTTP exception thrown: Instance ebb5a23e-99b6-483c-b332-5d855d82244d could not be found. May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Request method failure captured: May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d HTTP/1.1 May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLHWCudil6bmKV4qXJUpZrFIAFUI0CLe8J3mTDF9Bk8HtGjp9dfX4I53-T7msz-yjuEr7e-HzxZgfRI1A1Dm2J5_BvqUtoDyeWkxE8ZNECFoi7aX7NQXPf6hf4MIoMd18pIfH1W4VuYqsraGnlxMt6OK4vvd7ni3ZJN6EggVXtnSad8 May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f4c9c14cf4bc42878a2f63a0ffa2762e May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-TestMinimumBasicScenario-1960487919 May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:24:28.665776 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4c9c14cf4bc42878a2f63a0ffa2762e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4c9c14cf4bc42878a2f63a0ffa2762e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4c9c14cf4bc42878a2f63a0ffa2762e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4c9c14cf4bc42878a2f63a0ffa2762e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-TestMinimumBasicScenario-1960487919 May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f4c9c14cf4bc42878a2f63a0ffa2762e May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1960487919 May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-TestMinimumBasicScenario-1960487919-project May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: c793637b93de4def9e2dd271c96f26a2 May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-TestMinimumBasicScenario-1960487919-project May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance ebb5a23e-99b6-483c-b332-5d855d82244d could not be found. May 24 10:24:28.667880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'ebb5a23e-99b6-483c-b332-5d855d82244d'} May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb5a23e-99b6-483c-b332-5d855d82244d could not be found. May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:24:28.668860 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb5a23e-99b6-483c-b332-5d855d82244d could not be found. May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb5a23e-99b6-483c-b332-5d855d82244d could not be found. May 24 10:24:28.670654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:24:28.672142 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Returning 404 to user: Instance ebb5a23e-99b6-483c-b332-5d855d82244d could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:24:28.672142 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-897fcae2-a4fa-4d4f-91b1-59aeb7cb54ad tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d" status: 404 len: 111 microversion: 2.1 time: 0.057354 May 24 10:24:28.672142 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 490/971] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:24:28 2022] GET /compute/v2.1/servers/ebb5a23e-99b6-483c-b332-5d855d82244d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:24:28.677061 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a7c70b88-3ce5-4489-a4b9-b03ff4b690b9 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] Calling method '.version_select at 0x7ff63affd670>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:28.774214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a7c70b88-3ce5-4489-a4b9-b03ff4b690b9 tempest-TestMinimumBasicScenario-1960487919 tempest-TestMinimumBasicScenario-1960487919-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-697877463" status: 202 len: 0 microversion: 2.1 time: 0.100725 May 24 10:24:28.775050 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 482/972] 10.222.0.44 () {58 vars in 1268 bytes} [Tue May 24 10:24:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-697877463 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:24:29.671285 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:29.671952 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:29.678697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:29.679230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:29.680002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:29.680431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:29.814128 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:29.821955 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:29.823435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:29.824987 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-da8fac21-2b8c-4e20-a5e5-aba87d83ff36 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.158324 May 24 10:24:29.825534 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 491/973] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:29 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:30.843413 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:30.844114 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:30.851721 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:30.852597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:30.853615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:30.854285 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:31.413223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:31.422714 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:31.424552 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:31.425847 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1ae0966b-87e8-4f37-9ae8-e99ec67fd03b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.586852 May 24 10:24:31.426585 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 483/974] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:30 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:32.450299 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:32.450979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:32.459003 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:32.459469 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:32.460383 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:32.461340 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:32.698307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:32.708202 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:32.710313 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:32.712187 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fb685cd5-a184-456a-baaf-70618a604b5c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.271691 May 24 10:24:32.712906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 492/975] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:32 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:33.731258 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:33.732715 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:33.742005 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:33.742935 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:33.743994 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:33.744647 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:33.919204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:33.927919 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:33.929703 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:33.931038 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c0e2fbd2-ec8e-4013-bce0-5510cccdb222 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.204316 May 24 10:24:33.931592 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 484/976] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:33 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:34.950901 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:34.952219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:34.959413 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:34.959925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:34.961141 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:34.961753 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:35.119034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:35.140716 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:35.142676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:35.144188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5b74ef11-5712-4bcb-b930-62c3c3ce3849 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.198056 May 24 10:24:35.159857 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 493/977] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:34 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:36.163571 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:36.165693 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:36.181535 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:36.189251 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:36.190505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:36.193011 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:36.686214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:36.696468 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:36.704397 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:36.712310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-686738b9-f957-4a29-9e5a-0609326a55dc tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.552604 May 24 10:24:36.723556 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 485/978] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:36 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:37.732598 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:37.733217 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:37.735744 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=47 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:37.740949 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:37.742527 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:37.742527 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:37.743075 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:38.005590 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:38.013718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:38.015204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:38.016418 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-484e27bb-ae27-49b2-a6a5-ba2180c8788f tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1738 microversion: 2.20 time: 0.289624 May 24 10:24:38.016981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 494/979] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:37 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:39.034223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:39.034826 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:39.037400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:39.042074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:39.042523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:39.043277 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:39.043709 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:39.203460 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:39.217604 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:39.219150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:39.220417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9a3a851d-df6c-4448-84ef-958e3ba9726b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1720 microversion: 2.20 time: 0.190051 May 24 10:24:39.220967 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 486/980] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:39 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:40.240849 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:40.241454 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:40.248509 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:40.248959 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:40.249731 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:40.250158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:40.384941 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:40.393007 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:40.394503 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:40.395657 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-129fa9fe-c92d-4211-8896-8361df0bffb5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1720 microversion: 2.20 time: 0.158766 May 24 10:24:40.396315 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 495/981] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:40 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:41.414869 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:41.415584 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:41.422787 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:41.423240 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:41.424044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:41.424477 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:41.558647 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:41.567899 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:41.569601 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:41.571090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9af4921b-0608-416e-8f53-eb3d151e2cb6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1663 microversion: 2.20 time: 0.160564 May 24 10:24:41.571651 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 487/982] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:41 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:41.589254 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-28485646-fe37-4395-962e-c684c12d9a2b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8636e3c3-e6a2-4710-999d-81a3ce5fd212"}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:41.590320 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-28485646-fe37-4395-962e-c684c12d9a2b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:41.596754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28485646-fe37-4395-962e-c684c12d9a2b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:41.597208 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28485646-fe37-4395-962e-c684c12d9a2b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:41.597973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28485646-fe37-4395-962e-c684c12d9a2b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:41.598410 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28485646-fe37-4395-962e-c684c12d9a2b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:42.512161 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-28485646-fe37-4395-962e-c684c12d9a2b tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.927182 May 24 10:24:42.512943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 496/983] 10.222.0.44 () {62 vars in 1363 bytes} [Tue May 24 10:24:41 2022] POST /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-volume_attachments => generated 188 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 24 10:24:42.531939 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-5f7a2f0f-746d-44ab-86e4-6e7528c4ff5a req-496411a2-68df-4e7b-bdcc-4559532b6218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b16a9a-c684-4154-b1d6-5f8530007d73", "name": "network-vif-unplugged", "status": "completed", "tag": "9da6301e-3531-43c6-8a9d-e3c9c4997951"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:42.541679 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5f7a2f0f-746d-44ab-86e4-6e7528c4ff5a req-496411a2-68df-4e7b-bdcc-4559532b6218 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:42.542215 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-5f7a2f0f-746d-44ab-86e4-6e7528c4ff5a req-496411a2-68df-4e7b-bdcc-4559532b6218 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:42.553333 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.compute.server_external_events [req-5f7a2f0f-746d-44ab-86e4-6e7528c4ff5a req-496411a2-68df-4e7b-bdcc-4559532b6218 service nova] Unable to find a host for instance 09b16a9a-c684-4154-b1d6-5f8530007d73. Dropping event network-vif-unplugged {{(pid=118131) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 24 10:24:42.554208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-5f7a2f0f-746d-44ab-86e4-6e7528c4ff5a req-496411a2-68df-4e7b-bdcc-4559532b6218 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026179 May 24 10:24:42.554951 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 488/984] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 24 10:24:42.629768 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-88f7bb05-15ab-4c7a-973f-bd0d570e7be5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:42.630272 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-88f7bb05-15ab-4c7a-973f-bd0d570e7be5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:42.638297 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88f7bb05-15ab-4c7a-973f-bd0d570e7be5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:42.638751 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88f7bb05-15ab-4c7a-973f-bd0d570e7be5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:42.639551 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88f7bb05-15ab-4c7a-973f-bd0d570e7be5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:42.640036 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-88f7bb05-15ab-4c7a-973f-bd0d570e7be5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:43.202367 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-88f7bb05-15ab-4c7a-973f-bd0d570e7be5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-volume_attachments/8636e3c3-e6a2-4710-999d-81a3ce5fd212" status: 202 len: 0 microversion: 2.20 time: 0.576425 May 24 10:24:43.202901 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 497/985] 10.222.0.44 () {60 vars in 1456 bytes} [Tue May 24 10:24:42 2022] DELETE /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-volume_attachments/8636e3c3-e6a2-4710-999d-81a3ce5fd212 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:24:43.259820 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-6befb638-4e1e-47e3-99e6-44b632cc9ec6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:24:43.260433 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-6befb638-4e1e-47e3-99e6-44b632cc9ec6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:43.266607 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6befb638-4e1e-47e3-99e6-44b632cc9ec6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:43.267051 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6befb638-4e1e-47e3-99e6-44b632cc9ec6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:43.267863 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6befb638-4e1e-47e3-99e6-44b632cc9ec6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:43.268299 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-6befb638-4e1e-47e3-99e6-44b632cc9ec6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:43.480048 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-6befb638-4e1e-47e3-99e6-44b632cc9ec6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "POST /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/action" status: 202 len: 0 microversion: 2.20 time: 0.223954 May 24 10:24:43.481128 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 489/986] 10.222.0.44 () {62 vars in 1318 bytes} [Tue May 24 10:24:43 2022] POST /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 24 10:24:43.489267 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:43.495067 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:43.496035 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:43.496499 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:43.497271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:43.497711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:43.627200 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:43.635233 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:43.636848 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:43.638002 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-67d874f3-fe21-46b2-9bf7-aeb09b1e7da4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1671 microversion: 2.20 time: 0.152769 May 24 10:24:43.638554 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 498/987] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:43 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:44.657518 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:44.658062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:44.664094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:44.664541 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:44.665302 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:44.665735 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:44.800074 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:44.807971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:44.810255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:44.811407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bf0fba67-386f-4d97-b48f-a95a4c1d00c4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1671 microversion: 2.20 time: 0.158579 May 24 10:24:44.812032 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 490/988] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:44 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:45.830463 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:45.831091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:45.838497 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:45.838952 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:45.839835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:45.840512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:45.975847 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:45.984889 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:45.986401 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:45.987589 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-dd5df9aa-99a1-4164-9a82-cb886cb65f29 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.161108 May 24 10:24:45.988181 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 499/989] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:45 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:47.005924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:47.006444 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:47.013379 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:47.013825 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:47.014660 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:47.015095 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:47.156675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:47.164565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:47.166109 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:47.167390 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-740cfca3-8db4-4e92-a484-b74a1e413669 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.165296 May 24 10:24:47.168479 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 491/990] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:47 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:48.186194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:48.186806 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:48.193539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:48.193997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:48.194777 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:48.195216 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:48.347250 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:48.355808 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:48.357348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:48.358542 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f4989e12-af25-4149-bd06-b360714ee5ae tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.176388 May 24 10:24:48.359105 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 500/991] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:48 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:49.378204 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:49.379733 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:49.387979 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:49.388848 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:49.389640 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:49.390139 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:49.531381 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:49.539714 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:49.542000 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:49.544174 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0433dec8-74c0-46ef-94ad-1974a9b3f743 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.170297 May 24 10:24:49.544937 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 492/992] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:49 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:50.570533 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:50.571169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:50.578216 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:50.578660 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:50.579431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:50.579907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:50.721681 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:50.723917 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:50.730786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:50.732344 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:50.733471 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-28f3f2e1-a220-4511-a81a-ef2817272c71 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.166954 May 24 10:24:50.734029 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 501/993] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:50 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:51.752944 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:51.753536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:51.759993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:51.760446 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:51.761861 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:51.762449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:51.915385 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:51.924154 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:51.925785 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:51.926986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-654db3bb-020a-459b-b210-a5e643ed55cd tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.178042 May 24 10:24:51.929390 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 493/994] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:51 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:52.945735 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:52.946479 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:52.953462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:52.953906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:52.954664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:52.955091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:53.093010 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:53.101593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:53.103458 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:53.104370 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1d7ac019-40ba-4a62-95a6-b8eda8db3c25 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.162507 May 24 10:24:53.107876 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 502/995] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:52 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:54.122982 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:54.123833 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:54.131824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:54.132648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:54.133453 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:54.134296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:54.289475 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:54.297953 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:54.299442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:54.300634 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-afb4703f-7055-4451-b579-043ad37b5d44 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.182044 May 24 10:24:54.301394 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 494/996] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:54 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:55.318740 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:55.319339 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:55.326476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:55.326920 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:55.327718 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:55.332319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:55.460319 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:55.468516 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:55.470061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:55.471230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-714c5ae0-033c-44c1-86d8-4a6fa34b8021 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.156383 May 24 10:24:55.471788 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 503/997] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:55 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:56.489629 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:56.490229 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:56.496791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:56.497238 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:56.497989 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:56.498420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:56.500976 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:24:56.628098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:56.636430 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:56.637938 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:56.639091 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-660e84be-2367-421a-b86f-7f72eb258e3c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.153412 May 24 10:24:56.639657 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 495/998] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:56 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:24:57.657173 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:57.657769 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:57.664294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:57.664735 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:57.665484 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:57.665912 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:57.791040 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:57.800019 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:57.801511 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:57.802657 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8f0fb638-1439-4552-97a3-b27daff82889 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.149404 May 24 10:24:57.803214 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 504/999] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:57 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 24 10:24:58.820746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:24:58.821372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:24:58.828799 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:58.833782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:58.833782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:24:58.833782 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:24:59.033152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:59.041135 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:59.043653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:24:59.044843 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b0c3bbcd-72b9-4d07-b90f-e5a9694a9407 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.228104 May 24 10:24:59.045414 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 496/1000] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:24:58 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:00.062335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:00.062972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:00.069471 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:00.069922 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:00.070703 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:00.071133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:00.199465 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:00.207386 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:00.208936 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:00.210242 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-ec488a4f-77f6-41d9-bb50-8590500a137c tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.151602 May 24 10:25:00.210649 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 505/1001] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:00 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:00.635100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-89b501fb-41ca-42f4-a57c-12a2d1bb3520 req-bf98b5ee-6eb2-4766-9ca0-eafcd80f01d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b16a9a-c684-4154-b1d6-5f8530007d73", "name": "network-vif-plugged", "status": "completed", "tag": "9da6301e-3531-43c6-8a9d-e3c9c4997951"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:25:00.644497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-89b501fb-41ca-42f4-a57c-12a2d1bb3520 req-bf98b5ee-6eb2-4766-9ca0-eafcd80f01d4 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:00.644934 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-89b501fb-41ca-42f4-a57c-12a2d1bb3520 req-bf98b5ee-6eb2-4766-9ca0-eafcd80f01d4 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:00.655576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-89b501fb-41ca-42f4-a57c-12a2d1bb3520 req-bf98b5ee-6eb2-4766-9ca0-eafcd80f01d4 service nova] Creating event network-vif-plugged:9da6301e-3531-43c6-8a9d-e3c9c4997951 for instance 09b16a9a-c684-4154-b1d6-5f8530007d73 on hv-cinder-81045 May 24 10:25:00.660625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-89b501fb-41ca-42f4-a57c-12a2d1bb3520 req-bf98b5ee-6eb2-4766-9ca0-eafcd80f01d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029268 May 24 10:25:00.661255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 497/1002] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:01.228816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:01.229942 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:01.236466 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:01.236913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:01.237663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:01.238092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:01.368325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:01.376159 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:01.377663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:01.378789 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-258c14f9-636a-4cc9-837c-ddd8aeca7c89 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.154036 May 24 10:25:01.379622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 506/1003] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:01 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:02.397766 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:02.398483 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:02.405436 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:02.405881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:02.406634 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:02.407062 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:02.544842 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:02.552967 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:02.554482 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:02.555633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b19363a0-212a-4416-ac05-55f26e2f9e24 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.162656 May 24 10:25:02.566523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 498/1004] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:02 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:03.574380 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:03.574984 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:03.581490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:03.581936 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:03.582693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:03.583130 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:03.713559 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:03.722052 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:03.723547 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:03.724734 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-fb2cd914-d942-4d48-81c9-07bab495bcb2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1729 microversion: 2.20 time: 0.154599 May 24 10:25:03.725291 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 507/1005] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:03 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:04.743592 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:04.744182 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:04.750717 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:04.751171 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:04.751976 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:04.752426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:04.878216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:04.886989 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:04.888536 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:04.889688 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bd5a23e7-f980-4306-a563-a3ec72e332e2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1716 microversion: 2.20 time: 0.150083 May 24 10:25:04.890241 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 499/1006] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:04 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:08.678988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:25:08.679566 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:08.682195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=28 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:08.687615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:08.688181 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:08.688951 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:08.689465 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:08.714522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.objects.instance [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lazy-loading 'flavor' on Instance uuid cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b {{(pid=118130) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:25:09.010870 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-dee405c0-e8c9-4cd1-b75c-c68d32825944 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "POST /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b/action" status: 202 len: 0 microversion: 2.1 time: 0.335655 May 24 10:25:09.011405 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 508/1007] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:25:08 2022] POST /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:25:09.019752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:09.020394 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:09.026506 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:09.026958 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:09.028244 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:09.028672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:09.164383 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:09.172907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-42825345-2275-4ec9-8908-d6a27331a761 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.156869 May 24 10:25:09.174755 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 500/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:09 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:25:10.191617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:10.192350 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:10.198462 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:10.199410 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:10.200196 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:10.200617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:10.333464 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:10.341700 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0988df00-d0d5-411c-910e-5dafcd5aa363 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.154700 May 24 10:25:10.342264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 509/1009] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:10 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:11.358918 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:11.359608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:11.366219 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:11.366667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:11.367420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:11.367871 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:11.497055 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:11.504378 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b37a60e2-b205-411c-921a-573ee73139ff tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.149865 May 24 10:25:11.504936 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 501/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:11 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:12.522242 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:12.522843 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:12.529398 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:12.529841 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:12.530592 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:12.531020 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:12.660951 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:12.669518 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b8a82016-de4c-4d17-8718-2045650b293f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.151205 May 24 10:25:12.670085 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 510/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:12 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:13.688026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:13.688650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:13.690532 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=34 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:13.695157 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:13.695597 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:13.696387 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:13.696816 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:13.825892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:13.833317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-22cbc52e-854b-456c-832e-6f4e2d90cc48 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.150691 May 24 10:25:13.833886 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 502/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:13 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:14.851090 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:14.851697 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:14.857935 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:14.858389 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:14.859152 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:14.859586 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:14.986194 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:14.993600 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bb3752dd-a5a8-4797-b32a-e1c36747efe1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.146577 May 24 10:25:14.994154 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 511/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:14 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:16.010581 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:16.011827 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:16.018221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:16.018669 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:16.019425 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:16.019961 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:16.150125 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:16.158377 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7c063f5a-56cc-47b6-8ff0-f26248b58565 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.151633 May 24 10:25:16.158943 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 503/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:16 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:17.184967 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:17.185567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:17.191994 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:17.192438 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:17.193192 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:17.193622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:17.320278 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:17.328375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-97c9695d-e9f8-4e3a-89bf-ceadef273288 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.147904 May 24 10:25:17.328943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 512/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:17 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:18.346071 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:18.346681 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:18.353328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:18.353812 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:18.354631 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:18.355159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:18.486453 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:18.493906 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-01ccdf2a-3320-4ce5-b66b-4b298b808d3f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.151695 May 24 10:25:18.494497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 504/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:18 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:19.510538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:19.511711 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:19.518490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:19.518938 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:19.519707 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:19.520165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:19.650540 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:19.658757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-5d8a256c-0cd5-42cc-a335-4a98423a9b70 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.152139 May 24 10:25:19.659327 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 513/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:19 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:20.676478 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:20.677113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:20.684606 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:20.691411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:20.691411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:20.691411 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:20.815563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:20.822924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-eb18aa17-2688-415a-8fae-ff61508fc11b tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.150451 May 24 10:25:20.823523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 505/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:20 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:21.839092 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:21.839734 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:21.846148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:21.846591 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:21.847357 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:21.847784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:21.983597 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:21.991058 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-b92b7b52-b6cf-409d-96ef-32d78bf806d7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.156084 May 24 10:25:21.993261 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 514/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:21 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:23.008682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:23.009291 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:23.016502 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:23.016967 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:23.017711 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:23.018146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:23.145091 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:23.152583 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-09c7d0fd-e4e8-4553-bc86-0c025d94a3e7 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1510 microversion: 2.1 time: 0.147875 May 24 10:25:23.153143 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 506/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:23 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:23.168730 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8534c510-a2d7-4e60-8c1b-8b5c946c9a28 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:25:23.169290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8534c510-a2d7-4e60-8c1b-8b5c946c9a28 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:23.175766 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8534c510-a2d7-4e60-8c1b-8b5c946c9a28 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:23.176246 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8534c510-a2d7-4e60-8c1b-8b5c946c9a28 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:23.177008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8534c510-a2d7-4e60-8c1b-8b5c946c9a28 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:23.177445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8534c510-a2d7-4e60-8c1b-8b5c946c9a28 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:23.181083 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:23.422061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8534c510-a2d7-4e60-8c1b-8b5c946c9a28 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "POST /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b/action" status: 202 len: 0 microversion: 2.1 time: 0.257217 May 24 10:25:23.422671 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 515/1021] 10.222.0.44 () {60 vars in 1277 bytes} [Tue May 24 10:25:23 2022] POST /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:25:23.430784 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:23.431394 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:23.439189 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:23.439639 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:23.440468 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:23.440908 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:23.577777 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:23.585323 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c7828e52-a610-4435-8153-72e15d38b85c tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1518 microversion: 2.1 time: 0.158525 May 24 10:25:23.586076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 507/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:23 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:24.603003 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:24.603618 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:24.609924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:24.610435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:24.611326 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:24.611767 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:24.742811 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:24.754617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-59c7075c-521b-47c6-a1e3-3eb6f75d276a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1518 microversion: 2.1 time: 0.152899 May 24 10:25:24.754617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 516/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:24 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:24.764350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-75bd4689-7c7b-42c4-9984-60f815e8b39b req-431555f1-5834-417d-b6f4-a4df222b7e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b", "name": "network-vif-unplugged", "status": "completed", "tag": "2a0b8e37-c6df-4421-9de0-035e1f941fd5"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:25:24.773624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-75bd4689-7c7b-42c4-9984-60f815e8b39b req-431555f1-5834-417d-b6f4-a4df222b7e80 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:24.774071 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-75bd4689-7c7b-42c4-9984-60f815e8b39b req-431555f1-5834-417d-b6f4-a4df222b7e80 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:24.785738 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.compute.server_external_events [req-75bd4689-7c7b-42c4-9984-60f815e8b39b req-431555f1-5834-417d-b6f4-a4df222b7e80 service nova] Unable to find a host for instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b. Dropping event network-vif-unplugged {{(pid=118131) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 24 10:25:24.789046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-75bd4689-7c7b-42c4-9984-60f815e8b39b req-431555f1-5834-417d-b6f4-a4df222b7e80 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028013 May 24 10:25:24.789046 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 508/1024] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 24 10:25:25.769281 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:25.769896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:25.776478 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:25.776961 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:25.777732 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:25.778169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:25.911997 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:25.919879 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0d654b68-1f73-4a82-beec-ae494c164690 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1520 microversion: 2.1 time: 0.154418 May 24 10:25:25.920455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 517/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:25 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:26.938158 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:26.938860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:26.945380 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:26.945824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:26.946624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:26.947281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:27.080691 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:27.088527 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b8823389-285e-472e-bfee-797fd6949c17 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.154424 May 24 10:25:27.089692 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 509/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:26 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:28.106375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:28.106965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:28.113354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:28.113794 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:28.114545 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:28.114970 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:28.243219 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:28.251041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-30c54bf0-f97f-426b-a0ff-17814829f6d9 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.148771 May 24 10:25:28.251604 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 518/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:28 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:29.267921 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:29.268529 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:29.274852 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:29.275293 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:29.276076 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:29.276760 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:29.280267 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=82 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:29.407824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:29.415491 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-bc476d45-60f3-48a3-92fb-236aa34a8bbc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.151506 May 24 10:25:29.416036 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 510/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:29 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:30.433954 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:30.434585 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:30.441174 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:30.451567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:30.451567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:30.451567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:30.572655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:30.580073 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-57f028f6-9367-4dab-a2cd-e90e1d067d32 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.150764 May 24 10:25:30.580632 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 519/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:30 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:31.597662 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:31.598271 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:31.604552 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:31.605047 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:31.605809 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:31.606242 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:31.733643 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:31.741092 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-309ca276-e045-40fa-8de7-c29d768966f5 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.147274 May 24 10:25:31.741670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 511/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:31 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:32.758895 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:32.759466 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:32.766345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:32.766800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:32.767599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:32.768070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:32.897242 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:32.905439 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cd337ddc-b9c8-4c1a-b0f3-1fd2621b14db tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.150490 May 24 10:25:32.906005 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 520/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:32 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:33.923136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:33.923732 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:33.930352 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:33.930802 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:33.931555 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:33.932047 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:34.063949 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:34.071385 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fc1557d5-df71-40b8-b125-31f4c29ec485 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.152071 May 24 10:25:34.071972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 512/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:33 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:34.439314 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cc897235-48f5-467f-a413-dc8767971276 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:34.440463 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cc897235-48f5-467f-a413-dc8767971276 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:34.447133 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cc897235-48f5-467f-a413-dc8767971276 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:34.448154 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cc897235-48f5-467f-a413-dc8767971276 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:34.448690 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cc897235-48f5-467f-a413-dc8767971276 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:34.449230 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cc897235-48f5-467f-a413-dc8767971276 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:34.478138 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cc897235-48f5-467f-a413-dc8767971276 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042850 May 24 10:25:34.478683 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 521/1033] 10.222.0.44 () {60 vars in 1342 bytes} [Tue May 24 10:25:34 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:34.545415 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:34.545907 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:34.551892 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:34.552375 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:34.553141 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:34.553578 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:34.577669 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:25:34.920641 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-38e98e55-ea65-4cea-9bbb-998575d826f5 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 204 len: 0 microversion: 2.20 time: 0.379663 May 24 10:25:34.921224 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 513/1034] 10.222.0.44 () {60 vars in 1279 bytes} [Tue May 24 10:25:34 2022] DELETE /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 10:25:34.931072 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:34.931677 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:34.938040 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:34.938491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:34.939249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:34.939686 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:35.067099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:35.075536 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:35.077084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:35.078240 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-70108135-13ec-4d84-b323-0a20c1f1d5b0 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.151083 May 24 10:25:35.078825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 522/1035] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:34 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:35.089677 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:35.090407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:35.097971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:35.098427 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:35.099205 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:35.099645 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:35.233147 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:35.240701 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ba1710c0-6009-475a-a939-d209cc2a1d2a tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.155769 May 24 10:25:35.241277 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 514/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:35 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:25:36.098206 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:36.099110 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:36.107221 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:36.107681 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:36.108490 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:36.108926 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:36.238361 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:36.246455 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:36.247992 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:36.249759 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8b7ab3fc-c904-4984-8ff8-31c6cd6caa87 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1722 microversion: 2.20 time: 0.156111 May 24 10:25:36.250683 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 523/1037] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:36 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:36.258188 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:36.258894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:36.266014 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:36.266461 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:36.267221 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:36.267654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:36.397056 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:36.405211 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7e87dc4b-3b54-45ff-aff4-ec871dd3b7b1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.150874 May 24 10:25:36.405768 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 515/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:36 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:36.938276 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-5a24625e-0d5b-407d-ab7c-a545f1574e10 req-475ad031-191b-43f0-a805-fc430b7ae77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b", "name": "network-vif-plugged", "status": "completed", "tag": "2a0b8e37-c6df-4421-9de0-035e1f941fd5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:25:36.949792 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-5a24625e-0d5b-407d-ab7c-a545f1574e10 req-475ad031-191b-43f0-a805-fc430b7ae77f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:36.951151 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-5a24625e-0d5b-407d-ab7c-a545f1574e10 req-475ad031-191b-43f0-a805-fc430b7ae77f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:36.963449 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-5a24625e-0d5b-407d-ab7c-a545f1574e10 req-475ad031-191b-43f0-a805-fc430b7ae77f service nova] Creating event network-vif-plugged:2a0b8e37-c6df-4421-9de0-035e1f941fd5 for instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b on hv-cinder-81045 May 24 10:25:36.969091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-5a24625e-0d5b-407d-ab7c-a545f1574e10 req-475ad031-191b-43f0-a805-fc430b7ae77f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094033 May 24 10:25:36.970144 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 524/1039] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:37.269849 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:37.271960 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:37.281790 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:37.282241 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:37.283204 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:37.283647 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:37.365216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-1a1feebf-84e1-424e-8430-1ceb48855b43 req-f99ef3dd-1d53-4087-80ee-2614af5742c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09b16a9a-c684-4154-b1d6-5f8530007d73", "name": "network-vif-deleted", "tag": "9da6301e-3531-43c6-8a9d-e3c9c4997951"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:25:37.378846 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1a1feebf-84e1-424e-8430-1ceb48855b43 req-f99ef3dd-1d53-4087-80ee-2614af5742c3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:37.379310 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-1a1feebf-84e1-424e-8430-1ceb48855b43 req-f99ef3dd-1d53-4087-80ee-2614af5742c3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:37.384633 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:37.396626 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:37.398160 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:37.399365 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d9f935bd-642a-43c1-b660-6202f0a08310 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1656 microversion: 2.20 time: 0.134427 May 24 10:25:37.405334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 525/1040] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:37 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1656 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:37.409970 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-1a1feebf-84e1-424e-8430-1ceb48855b43 req-f99ef3dd-1d53-4087-80ee-2614af5742c3 service nova] Creating event network-vif-deleted:9da6301e-3531-43c6-8a9d-e3c9c4997951 for instance 09b16a9a-c684-4154-b1d6-5f8530007d73 on hv-cinder-81045 May 24 10:25:37.414293 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-1a1feebf-84e1-424e-8430-1ceb48855b43 req-f99ef3dd-1d53-4087-80ee-2614af5742c3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149439 May 24 10:25:37.415088 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 516/1041] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:37.422918 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:37.423396 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:37.429822 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:37.430306 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:37.431075 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:37.431519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:37.577025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:37.584753 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-55f2f933-c466-4757-b893-5dcdb2566c49 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.166299 May 24 10:25:37.589041 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 526/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:37 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:38.424407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:38.425107 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:38.431859 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:38.433034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:38.434120 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:38.434564 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:38.469231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:38.469684 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:38.470134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lazy-loading 'fault' on Instance uuid 09b16a9a-c684-4154-b1d6-5f8530007d73 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:25:38.512388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:38.521621 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:38.524881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4985774959804070b1d86f7e47b02473', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f868bceb050645bea79affcb406f94d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:38.524881 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-585b20cc-6422-4d70-aee0-20f5a9860095 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 200 len: 1371 microversion: 2.20 time: 0.104271 May 24 10:25:38.525210 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 517/1043] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:38 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 24 10:25:38.604384 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:38.605137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:38.611680 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:38.618451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:38.618451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:38.618451 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:38.744811 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:38.752424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0b3b70e8-5f7a-4905-bc88-a76d27db91df tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1576 microversion: 2.1 time: 0.152010 May 24 10:25:38.752985 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 527/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:38 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:39.543381 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:39.544017 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:39.550406 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:39.550855 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:39.551612 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:39.552077 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:39.566119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] HTTP exception thrown: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Request method failure captured: May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 HTTP/1.1 May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLFkXLABF2eAvvdQ6nKhcWyXCAd88JniLYIlk_u82OMj4V3AV6sGstiTUQhk7H85yuABYeuKPmSMTX1IHQXgKdyGCeMtHH8ZapRm7oy2H9ig500bUi6t7JzT95JYvKFLEQ632zwux_INrCn2Pi5NCg-lt7h4IGxfKJnMbnhGD3NkFzs May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Openstack-Nova-Api-Version: 2.20 May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:25:39.567746 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f868bceb050645bea79affcb406f94d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f868bceb050645bea79affcb406f94d1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 4985774959804070b1d86f7e47b02473 May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:39.569523 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '09b16a9a-c684-4154-b1d6-5f8530007d73'} May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:25:39.570408 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:39.571783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:39.573373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Returning 404 to user: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:25:39.573373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-7647de08-d5a9-489c-9052-7a313bc34e4e tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 404 len: 111 microversion: 2.20 time: 0.030200 May 24 10:25:39.573373 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 518/1045] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:39 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 10:25:39.578247 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d200756e-64c0-4a9b-bbc6-ed71b79dfcf2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '.version_select at 0x7ff64027ed30>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:39.584158 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=42 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:39.681225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d200756e-64c0-4a9b-bbc6-ed71b79dfcf2 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392822746" status: 204 len: 0 microversion: 2.20 time: 0.106981 May 24 10:25:39.681855 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 528/1046] 10.222.0.44 () {60 vars in 1261 bytes} [Tue May 24 10:25:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392822746 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 24 10:25:39.770226 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:39.770814 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:39.777541 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:39.777995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:39.778769 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:39.779198 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:39.924210 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:25:39.933353 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5860e043-d43c-4936-86e0-7334915f2eda tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1563 microversion: 2.1 time: 0.167120 May 24 10:25:39.934166 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 519/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:25:39 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:41.678754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:41.682894 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:41.686626 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:41.687078 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:41.687905 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:41.688344 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:41.703397 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] HTTP exception thrown: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Request method failure captured: May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 HTTP/1.1 May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLFkXLABF2eAvvdQ6nKhcWyXCAd88JniLYIlk_u82OMj4V3AV6sGstiTUQhk7H85yuABYeuKPmSMTX1IHQXgKdyGCeMtHH8ZapRm7oy2H9ig500bUi6t7JzT95JYvKFLEQ632zwux_INrCn2Pi5NCg-lt7h4IGxfKJnMbnhGD3NkFzs May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Openstack-Nova-Api-Version: 2.20 May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:25:41.705033 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f868bceb050645bea79affcb406f94d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f868bceb050645bea79affcb406f94d1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 4985774959804070b1d86f7e47b02473 May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.706791 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '09b16a9a-c684-4154-b1d6-5f8530007d73'} May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:25:41.707603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.708906 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:41.710215 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Returning 404 to user: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:25:41.710215 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e1659c54-9f24-4004-8469-918f062920ce tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 404 len: 111 microversion: 2.20 time: 0.031672 May 24 10:25:41.710215 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 529/1048] 10.222.0.44 () {60 vars in 1279 bytes} [Tue May 24 10:25:41 2022] DELETE /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 10:25:41.715839 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:41.716483 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: 09b16a9a-c684-4154-b1d6-5f8530007d73] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:41.723264 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:41.723712 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:41.724508 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:41.724942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:41.738333 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] HTTP exception thrown: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Request method failure captured: May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 HTTP/1.1 May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLFkXLABF2eAvvdQ6nKhcWyXCAd88JniLYIlk_u82OMj4V3AV6sGstiTUQhk7H85yuABYeuKPmSMTX1IHQXgKdyGCeMtHH8ZapRm7oy2H9ig500bUi6t7JzT95JYvKFLEQ632zwux_INrCn2Pi5NCg-lt7h4IGxfKJnMbnhGD3NkFzs May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Openstack-Nova-Api-Version: 2.20 May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:25:41.739891 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f868bceb050645bea79affcb406f94d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f868bceb050645bea79affcb406f94d1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 4985774959804070b1d86f7e47b02473 May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.741586 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '09b16a9a-c684-4154-b1d6-5f8530007d73'} May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:25:41.742496 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. May 24 10:25:41.744113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:41.745462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Returning 404 to user: Instance 09b16a9a-c684-4154-b1d6-5f8530007d73 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:25:41.745462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fc0732e6-501d-4c87-8b98-89817ea184d4 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73" status: 404 len: 111 microversion: 2.20 time: 0.030359 May 24 10:25:41.745462 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 520/1049] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:41 2022] GET /compute/v2.1/servers/09b16a9a-c684-4154-b1d6-5f8530007d73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 10:25:43.025476 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:43.025970 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:43.032583 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:43.033070 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:43.033836 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:43.034275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:43.047784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] HTTP exception thrown: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Request method failure captured: May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: DELETE /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 HTTP/1.1 May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLFkXLABF2eAvvdQ6nKhcWyXCAd88JniLYIlk_u82OMj4V3AV6sGstiTUQhk7H85yuABYeuKPmSMTX1IHQXgKdyGCeMtHH8ZapRm7oy2H9ig500bUi6t7JzT95JYvKFLEQ632zwux_INrCn2Pi5NCg-lt7h4IGxfKJnMbnhGD3NkFzs May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Openstack-Nova-Api-Version: 2.20 May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:25:43.049345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f868bceb050645bea79affcb406f94d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f868bceb050645bea79affcb406f94d1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 4985774959804070b1d86f7e47b02473 May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.051042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'fe007745-7114-45bd-beef-67cbecf48624'} May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:25:43.052034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.053553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:25:43.055168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Returning 404 to user: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:25:43.055168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2003097f-134b-4163-93b6-de593698c167 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 404 len: 111 microversion: 2.20 time: 0.029073 May 24 10:25:43.055168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 530/1050] 10.222.0.44 () {60 vars in 1279 bytes} [Tue May 24 10:25:43 2022] DELETE /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 10:25:43.059720 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:43.060367 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] [instance: fe007745-7114-45bd-beef-67cbecf48624] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:25:43.066805 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:43.067255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:43.068044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:25:43.068484 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:25:43.081762 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] HTTP exception thrown: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Request method failure captured: May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 HTTP/1.1 May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLFkXLABF2eAvvdQ6nKhcWyXCAd88JniLYIlk_u82OMj4V3AV6sGstiTUQhk7H85yuABYeuKPmSMTX1IHQXgKdyGCeMtHH8ZapRm7oy2H9ig500bUi6t7JzT95JYvKFLEQ632zwux_INrCn2Pi5NCg-lt7h4IGxfKJnMbnhGD3NkFzs May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Openstack-Nova-Api-Version: 2.20 May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:25:43.083306 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f868bceb050645bea79affcb406f94d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f868bceb050645bea79affcb406f94d1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f868bceb050645bea79affcb406f94d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: f868bceb050645bea79affcb406f94d1 May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-798657894 May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 4985774959804070b1d86f7e47b02473 May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-AttachVolumeShelveTestJSON-798657894-project May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.085097 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': 'fe007745-7114-45bd-beef-67cbecf48624'} May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:25:43.085916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. May 24 10:25:43.087434 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:25:43.088625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] Returning 404 to user: Instance fe007745-7114-45bd-beef-67cbecf48624 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:25:43.088625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e93699a4-7c9d-473a-bab7-47e8fe5328e6 tempest-AttachVolumeShelveTestJSON-798657894 tempest-AttachVolumeShelveTestJSON-798657894-project] 10.222.0.44 "GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624" status: 404 len: 111 microversion: 2.20 time: 0.029533 May 24 10:25:43.088625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 521/1051] 10.222.0.44 () {60 vars in 1276 bytes} [Tue May 24 10:25:43 2022] GET /compute/v2.1/servers/fe007745-7114-45bd-beef-67cbecf48624 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 24 10:25:50.073765 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-2008b48b-1471-4192-8bec-b18f4198e54b tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff64179aa60>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:50.121232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-2008b48b-1471-4192-8bec-b18f4198e54b tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/cae6423d-2718-4e53-855c-26eaaf0c7793" status: 200 len: 351 microversion: 2.1 time: 0.051311 May 24 10:25:50.122308 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 531/1052] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:25:50 2022] GET /compute/v2.1/os-volumes/cae6423d-2718-4e53-855c-26eaaf0c7793 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:51.733566 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-75a7a939-60df-432f-bd96-fe04e4cc1d61 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff63ae034c0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:51.780239 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-75a7a939-60df-432f-bd96-fe04e4cc1d61 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/42187479-f1b7-4e63-ad0e-0b254ef0b84e" status: 200 len: 351 microversion: 2.1 time: 0.051158 May 24 10:25:51.780824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 522/1053] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:25:51 2022] GET /compute/v2.1/os-volumes/42187479-f1b7-4e63-ad0e-0b254ef0b84e => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:53.365733 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:53.366559 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:53.370298 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-facfb907-76fe-4d67-9b1b-946756523b8b tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff640158dc0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:53.417338 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-facfb907-76fe-4d67-9b1b-946756523b8b tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74e90847-bcf0-4660-83eb-2029d2c78d1b" status: 200 len: 350 microversion: 2.1 time: 0.052786 May 24 10:25:53.417907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 532/1054] 10.222.0.44 () {58 vars in 1244 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes/74e90847-bcf0-4660-83eb-2029d2c78d1b => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:53.426214 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:53.426986 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:25:53.430775 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e1f2e1db-44f4-4b44-97a1-7d415df8146a tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff6400e0ee0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:53.513742 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e1f2e1db-44f4-4b44-97a1-7d415df8146a tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087962 May 24 10:25:53.514505 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 523/1055] 10.222.0.44 () {58 vars in 1133 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:53.526838 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c485e351-36bd-4ff4-8376-56d64db9a88a tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff6400fbc10>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:53.608481 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c485e351-36bd-4ff4-8376-56d64db9a88a tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085490 May 24 10:25:53.609054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 533/1056] 10.222.0.44 () {58 vars in 1148 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:53.620651 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-8e5b7484-cb4f-490e-8f33-a02206e5e48d tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff6400618b0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:53.701435 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-8e5b7484-cb4f-490e-8f33-a02206e5e48d tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084585 May 24 10:25:53.702034 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 524/1057] 10.222.0.44 () {58 vars in 1133 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:53.713060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-70cf269f-712f-47b7-bbcc-19b9fac7ad9b tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff64179aa60>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:53.792572 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-70cf269f-712f-47b7-bbcc-19b9fac7ad9b tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083413 May 24 10:25:53.793136 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 534/1058] 10.222.0.44 () {58 vars in 1166 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:53.806869 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-516cda77-7979-45ee-99eb-7ec1d616f9d1 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff63aded9d0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:53.889633 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-516cda77-7979-45ee-99eb-7ec1d616f9d1 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086438 May 24 10:25:53.890202 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 525/1059] 10.222.0.44 () {58 vars in 1169 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:53.901695 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-52f065a8-0cf1-4adc-b2c0-c630696ef2ec tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff640158310>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:53.982831 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-52f065a8-0cf1-4adc-b2c0-c630696ef2ec tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084769 May 24 10:25:53.983431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 535/1060] 10.222.0.44 () {58 vars in 1154 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:25:53.994549 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ce7a8313-eba9-4d89-860c-6ea23e8a87c0 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff6400c6e50>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:54.074131 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ce7a8313-eba9-4d89-860c-6ea23e8a87c0 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083492 May 24 10:25:54.074838 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 526/1061] 10.222.0.44 () {58 vars in 1187 bytes} [Tue May 24 10:25:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:25:54.086768 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e60dc445-f317-43b8-9182-055c5b2d1680 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] Calling method '.version_select at 0x7ff6400fbca0>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:25:54.340188 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e60dc445-f317-43b8-9182-055c5b2d1680 tempest-VolumesTestJSON-618566169 tempest-VolumesTestJSON-618566169-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.257242 May 24 10:25:54.340752 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 536/1062] 10.222.0.44 () {58 vars in 1154 bytes} [Tue May 24 10:25:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:26:54.526529 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:26:54.527077 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:26:54.533731 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:54.534675 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:54.535709 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:54.536304 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:54.537028 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-90c49c37-b6b7-4979-9e13-9794e7747342 req-61a1d6f1-4fb6-43fc-a81e-b76adb28a93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b", "tag": "2a0b8e37-c6df-4421-9de0-035e1f941fd5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:26:54.546924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-90c49c37-b6b7-4979-9e13-9794e7747342 req-61a1d6f1-4fb6-43fc-a81e-b76adb28a93b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:54.547371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-90c49c37-b6b7-4979-9e13-9794e7747342 req-61a1d6f1-4fb6-43fc-a81e-b76adb28a93b service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:54.559653 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-90c49c37-b6b7-4979-9e13-9794e7747342 req-61a1d6f1-4fb6-43fc-a81e-b76adb28a93b service nova] Creating event network-changed:2a0b8e37-c6df-4421-9de0-035e1f941fd5 for instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b on hv-cinder-81045 May 24 10:26:54.563257 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:26:54.565176 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-90c49c37-b6b7-4979-9e13-9794e7747342 req-61a1d6f1-4fb6-43fc-a81e-b76adb28a93b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034029 May 24 10:26:54.566093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 537/1063] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:26:54.978962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-353b7b89-51b6-486e-810d-b586fed2b659 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 204 len: 0 microversion: 2.1 time: 0.458278 May 24 10:26:54.979554 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 527/1064] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:26:54 2022] DELETE /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 10:26:54.988264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:26:54.988952 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:26:54.995529 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:54.996101 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:54.996877 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:54.997307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:55.129210 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:26:55.141645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-30ea1b07-449d-4347-a177-2cbea5d37c37 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.153282 May 24 10:26:55.141645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 538/1065] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:26:54 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:26:56.155293 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:26:56.156008 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:26:56.162350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:56.162794 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:56.163544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:56.163999 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:56.297622 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:26:56.305319 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2281cd5d-8690-4a7c-afa5-01a646b6decc tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.154543 May 24 10:26:56.305883 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 528/1066] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:26:56 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:26:57.323419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:26:57.324061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:26:57.330562 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:57.331013 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:57.331781 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:57.332245 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:57.464477 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:26:57.471979 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1fd91e8a-0794-4bb0-bf2f-16e1aa02dcf1 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1569 microversion: 2.1 time: 0.153172 May 24 10:26:57.472545 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 539/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:26:57 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:26:58.489233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:26:58.489984 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:26:58.496470 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:58.501108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:58.501108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:58.501108 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:58.692009 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:26:58.701727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3b33940c-9f1b-4e51-8b6b-46d770a9b1e6 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1450 microversion: 2.1 time: 0.216502 May 24 10:26:58.704646 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 529/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:26:58 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1450 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:26:59.082585 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-7ad9c5dc-1cc4-40bc-93fb-78503c50e5b9 req-decb717f-f339-48fa-a4d3-3c9bb59f57e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b", "name": "network-vif-deleted", "tag": "2a0b8e37-c6df-4421-9de0-035e1f941fd5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:26:59.090943 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-7ad9c5dc-1cc4-40bc-93fb-78503c50e5b9 req-decb717f-f339-48fa-a4d3-3c9bb59f57e1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:59.095538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-7ad9c5dc-1cc4-40bc-93fb-78503c50e5b9 req-decb717f-f339-48fa-a4d3-3c9bb59f57e1 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:59.101995 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-7ad9c5dc-1cc4-40bc-93fb-78503c50e5b9 req-decb717f-f339-48fa-a4d3-3c9bb59f57e1 service nova] Creating event network-vif-deleted:2a0b8e37-c6df-4421-9de0-035e1f941fd5 for instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b on hv-cinder-81045 May 24 10:26:59.107475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-7ad9c5dc-1cc4-40bc-93fb-78503c50e5b9 req-decb717f-f339-48fa-a4d3-3c9bb59f57e1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145833 May 24 10:26:59.108086 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 540/1069] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:26:59.718777 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:26:59.719329 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:26:59.725644 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:59.726091 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:59.726843 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:26:59.727275 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:26:59.809744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21f92d1ca604c0f9c93b81ed0904a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b866575bf960414ba6be2ac0fffe5e11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:26:59.818117 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-318f660a-43bf-45c6-a24b-b54562260399 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 200 len: 1220 microversion: 2.1 time: 0.103205 May 24 10:26:59.818901 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 530/1070] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:26:59 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:00.838349 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:00.839069 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] [instance: cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:00.845426 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:00.845872 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:00.846628 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:00.847060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:00.860267 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] HTTP exception thrown: Instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b could not be found. May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Request method failure captured: May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b HTTP/1.1 May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLHX4TYNODXMEtRbP-Cq4jr4OqUWOeWL0mTXMiTu4rLab11QboySWvwYvXE6lv1DMUQkjsbcC_anmD3r_c7jl5I-bvbymiOwtPcaS6NmP43WwqZYb1NOsUQwk42QhNFNYsKcPAu9InFcdcRgcZDJ3zGEnzrUXOHerJ3c_obEaBR0mq4 May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: b866575bf960414ba6be2ac0fffe5e11 May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-TestShelveInstance-1366747627 May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:27:00.861902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b866575bf960414ba6be2ac0fffe5e11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b866575bf960414ba6be2ac0fffe5e11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b866575bf960414ba6be2ac0fffe5e11", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b866575bf960414ba6be2ac0fffe5e11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-TestShelveInstance-1366747627 May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: b866575bf960414ba6be2ac0fffe5e11 May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-TestShelveInstance-1366747627 May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-TestShelveInstance-1366747627-project May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: a21f92d1ca604c0f9c93b81ed0904a08 May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-TestShelveInstance-1366747627-project May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b could not be found. May 24 10:27:00.863676 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b'} May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b could not be found. May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:27:00.864915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b could not be found. May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b could not be found. May 24 10:27:00.866606 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:27:00.868248 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Returning 404 to user: Instance cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:27:00.868248 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-45ec0858-0efc-4842-8a4c-870acffd6d2f tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b" status: 404 len: 111 microversion: 2.1 time: 0.030589 May 24 10:27:00.868248 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 541/1071] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:00 2022] GET /compute/v2.1/servers/cb80fb40-eb14-4fbc-85d1-f0afdc67ae9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:27:01.102699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-70f6b6c9-2f0a-4c40-aab9-5af55daa2f50 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] Calling method '.version_select at 0x7ff63aebb3a0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:01.179090 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-70f6b6c9-2f0a-4c40-aab9-5af55daa2f50 tempest-TestShelveInstance-1366747627 tempest-TestShelveInstance-1366747627-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1027808749" status: 202 len: 0 microversion: 2.1 time: 0.080675 May 24 10:27:01.179674 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 531/1072] 10.222.0.44 () {58 vars in 1253 bytes} [Tue May 24 10:27:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1027808749 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:27:22.414445 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=10 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:22.416123 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=18 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:22.594830 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-520c1d05-b0fd-477c-8b50-513a6d078165 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Action: 'create', calling method: .version_select at 0x7ff63ae4e940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1216596019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJYdDLGIRFzelaD8PUDgF3ZFq1UNZCxAxzDXE9vl3xM+tMOZRLNYMqlq9jHup3zn4IXGW5zb7WzngWP/gdLUCQI6ImAdmxbp0R/Ks8pK1yP19PMmz18OPrFAaKxWQMeUg=="}} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:27:22.609615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-520c1d05-b0fd-477c-8b50-513a6d078165 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for project f4e96acc60714f0589d31139a8bf23ca. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:27:22.613666 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.quota [None req-520c1d05-b0fd-477c-8b50-513a6d078165 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for user 6ff111c533394fc6af6ee0f7488a877b and project f4e96acc60714f0589d31139a8bf23ca. Resources: {'key_pairs'} {{(pid=118130) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:27:22.693080 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-520c1d05-b0fd-477c-8b50-513a6d078165 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.283392 May 24 10:27:22.698599 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 542/1073] 10.222.0.44 () {60 vars in 1158 bytes} [Tue May 24 10:27:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:27:40.645753 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:40.646615 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:40.650701 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1281923693", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1216596019", "security_groups": [{"name": "tempest-secgroup-smoke-1022035824"}], "block_device_mapping_v2": [{"uuid": "030c2d35-8f79-4873-a4d9-6ac16c457d1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ee8b3f2-ecd6-4894-9d3f-f6828af2bc9e"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:27:40.761834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] validate_networks() for [('0ee8b3f2-ecd6-4894-9d3f-f6828af2bc9e', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:27:41.215733 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:27:41.216180 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:27:41.216654 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:27:41.217059 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:27:41.217471 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:27:41.226745 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:41.227196 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:41.228028 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:41.228464 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:41.244557 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for project f4e96acc60714f0589d31139a8bf23ca. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:27:41.248448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for user 6ff111c533394fc6af6ee0f7488a877b and project f4e96acc60714f0589d31139a8bf23ca. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:27:41.304400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:27:41.306451 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='030c2d35-8f79-4873-a4d9-6ac16c457d1f',volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:27:41.426981 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:27:41.427512 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:27:41.713879 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [67ebe00d-a258-414b-a063-cf7d635cd90e] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 24 10:27:42.720945 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [67ebe00d-a258-414b-a063-cf7d635cd90e] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 43656. May 24 10:27:42.725504 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3e22c730-1cb7-4d0f-9199-b9f2387e3370 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.081277 May 24 10:27:42.726159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 532/1074] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:27:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 2083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:27:42.733428 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=4 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:42.734546 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:42.739495 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c69d5975-2651-41c7-8ed7-e029711f4f79 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:42.740138 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c69d5975-2651-41c7-8ed7-e029711f4f79 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:42.794548 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c69d5975-2651-41c7-8ed7-e029711f4f79 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:42.801192 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c69d5975-2651-41c7-8ed7-e029711f4f79 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1095 microversion: 2.1 time: 0.069102 May 24 10:27:42.801758 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 543/1075] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:42 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:43.819036 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a4e5d3ad-9507-4d42-baec-7f6ab6e05909 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:43.819760 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a4e5d3ad-9507-4d42-baec-7f6ab6e05909 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:43.870810 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a4e5d3ad-9507-4d42-baec-7f6ab6e05909 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:43.877320 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a4e5d3ad-9507-4d42-baec-7f6ab6e05909 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1095 microversion: 2.1 time: 0.063395 May 24 10:27:43.878565 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 533/1076] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:43 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1095 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:44.895325 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:44.895961 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:44.903197 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:44.903645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:44.904683 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:44.905153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:44.973277 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:44.980767 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4538a53f-535e-4efe-9e71-d53d460dfb4d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1145 microversion: 2.1 time: 0.090178 May 24 10:27:44.981522 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 544/1077] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:44 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:45.997625 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:45.998231 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:46.006577 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:46.007016 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:46.008014 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:46.008449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:46.075671 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:46.083972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-27649636-1efe-4f2f-88e4-bcfe5fe42bac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1211 microversion: 2.1 time: 0.090376 May 24 10:27:46.087132 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 534/1078] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:45 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:47.101334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:47.101947 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:47.108521 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:47.108973 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:47.109739 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:47.110177 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:47.336845 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:47.345293 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-72317936-0051-473d-b6b8-28b0c232b26f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1279 microversion: 2.1 time: 0.247788 May 24 10:27:47.346374 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 545/1079] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:47 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:47.592461 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-94c02aa2-bf46-4a68-8c72-84da1f46fb86 req-939d24e3-b115-49ba-95ce-abb12a0b350f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7601025b-ab9e-44d6-8ad3-3ef174bbccf2", "tag": "a81cf75c-edbb-4027-8369-20688ef804fe"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:27:47.602571 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-94c02aa2-bf46-4a68-8c72-84da1f46fb86 req-939d24e3-b115-49ba-95ce-abb12a0b350f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:47.603111 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-94c02aa2-bf46-4a68-8c72-84da1f46fb86 req-939d24e3-b115-49ba-95ce-abb12a0b350f service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:47.616956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-94c02aa2-bf46-4a68-8c72-84da1f46fb86 req-939d24e3-b115-49ba-95ce-abb12a0b350f service nova] Creating event network-changed:a81cf75c-edbb-4027-8369-20688ef804fe for instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 on hv-cinder-81045 May 24 10:27:47.620401 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-94c02aa2-bf46-4a68-8c72-84da1f46fb86 req-939d24e3-b115-49ba-95ce-abb12a0b350f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036749 May 24 10:27:47.621004 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 535/1080] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:27:48.362453 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:48.363038 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:48.369958 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:48.370403 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:48.371163 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:48.371600 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:48.514881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:48.522444 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f45d536a-5bcb-4e55-be26-39ee45b96b13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.163911 May 24 10:27:48.523050 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 546/1081] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:48 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:49.544970 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:49.545659 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:49.552465 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:49.552909 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:49.553670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:49.554100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:49.681372 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:49.689146 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-babe6ebe-66b0-45b5-a1fa-8a27b67f1a54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.148849 May 24 10:27:49.689718 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 536/1082] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:49 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:50.706179 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:50.706806 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:50.713560 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:50.714001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:50.714757 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:50.715183 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:50.843402 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:50.850786 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f1eb3f45-f681-4db9-9c09-c3d5f66ebb13 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.148574 May 24 10:27:50.851339 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 547/1083] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:50 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:51.867549 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:51.868207 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:51.870570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:51.875572 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:51.876058 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:51.876824 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:51.877281 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:52.012500 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:52.020263 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-59d64e59-716a-4144-aa78-a110f48f19b3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.156518 May 24 10:27:52.020834 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 537/1084] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:51 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:53.036365 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:53.036968 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:53.039358 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:53.044381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:53.044834 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:53.045603 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:53.046040 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:53.178631 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:53.186145 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f0ab415f-223c-4881-b83c-fb5796080811 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.153760 May 24 10:27:53.186713 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 548/1085] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:53 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:54.204283 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:54.204916 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:54.207210 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=8 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:27:54.212037 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:54.212744 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:54.213504 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:54.213939 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:54.340995 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:54.348416 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-47c1b0bd-af8e-45ff-b1ba-a8f62fb1658c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.147900 May 24 10:27:54.348973 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 538/1086] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:54 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:55.365761 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:55.366290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:55.372748 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:55.373189 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:55.373938 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:55.374365 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:55.501872 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:55.509678 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8140263d-7fff-4f7d-85e9-2e6683a41307 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.148272 May 24 10:27:55.510251 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 549/1087] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:55 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:56.526512 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:56.527128 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:56.533833 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:56.534420 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:56.535230 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:56.535672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:56.667579 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:56.675653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c70d0052-184a-4e98-9b39-7af6a8058226 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.152428 May 24 10:27:56.676349 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 539/1088] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:56 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:57.692366 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:57.692971 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:57.704721 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:57.705102 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:57.705880 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:57.706972 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:57.849677 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:57.857728 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-732dab1b-8028-42a8-982a-ead70e6e0e27 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.169969 May 24 10:27:57.858314 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 550/1089] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:57 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:27:58.138417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-95af32c2-1a55-41da-a6f5-79cc8fb77922 req-6e4d0970-6c9a-40a1-a984-c52d7fe9f31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7601025b-ab9e-44d6-8ad3-3ef174bbccf2", "name": "network-vif-plugged", "status": "completed", "tag": "a81cf75c-edbb-4027-8369-20688ef804fe"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:27:58.147780 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-95af32c2-1a55-41da-a6f5-79cc8fb77922 req-6e4d0970-6c9a-40a1-a984-c52d7fe9f31a service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:58.148245 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-95af32c2-1a55-41da-a6f5-79cc8fb77922 req-6e4d0970-6c9a-40a1-a984-c52d7fe9f31a service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:58.165592 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-95af32c2-1a55-41da-a6f5-79cc8fb77922 req-6e4d0970-6c9a-40a1-a984-c52d7fe9f31a service nova] Creating event network-vif-plugged:a81cf75c-edbb-4027-8369-20688ef804fe for instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 on hv-cinder-81045 May 24 10:27:58.170667 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-95af32c2-1a55-41da-a6f5-79cc8fb77922 req-6e4d0970-6c9a-40a1-a984-c52d7fe9f31a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036738 May 24 10:27:58.171297 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 540/1090] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:27:58.874420 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:27:58.876758 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:27:58.881816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:58.882268 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:58.883084 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:27:58.883519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:27:59.011729 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:27:59.019742 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8a9265d6-0150-4e65-abb1-7c59743fa8e4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1267 microversion: 2.1 time: 0.149232 May 24 10:27:59.020870 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 551/1091] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:27:58 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:28:00.037727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:28:00.038423 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:28:00.044642 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:28:00.045094 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:28:00.045859 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:28:00.046296 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:28:00.178962 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:28:00.186960 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fea7f508-e6fd-4d46-ba16-d61661064377 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1455 microversion: 2.1 time: 0.153946 May 24 10:28:00.187540 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 541/1092] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:28:00 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:28:00.203389 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:28:00.205257 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:28:00.211148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:28:00.211595 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:28:00.212647 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:28:00.213094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:28:00.341658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:28:00.349472 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-f7eb840a-40f2-44ea-974b-e2678c0361f3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1455 microversion: 2.1 time: 0.149896 May 24 10:28:00.351966 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 552/1093] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:28:00 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1455 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:28:02.271082 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-45eba323-b0a5-40df-9914-7f6e11505fb5 req-c1a69df3-c1b7-4d35-b5d5-653767a1c854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7601025b-ab9e-44d6-8ad3-3ef174bbccf2", "tag": "a81cf75c-edbb-4027-8369-20688ef804fe"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:28:02.279205 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-45eba323-b0a5-40df-9914-7f6e11505fb5 req-c1a69df3-c1b7-4d35-b5d5-653767a1c854 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:28:02.279652 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-45eba323-b0a5-40df-9914-7f6e11505fb5 req-c1a69df3-c1b7-4d35-b5d5-653767a1c854 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:28:02.291106 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-45eba323-b0a5-40df-9914-7f6e11505fb5 req-c1a69df3-c1b7-4d35-b5d5-653767a1c854 service nova] Creating event network-changed:a81cf75c-edbb-4027-8369-20688ef804fe for instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 on hv-cinder-81045 May 24 10:28:02.296384 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-45eba323-b0a5-40df-9914-7f6e11505fb5 req-c1a69df3-c1b7-4d35-b5d5-653767a1c854 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029088 May 24 10:28:02.296969 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 542/1094] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:29:33.432136 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:29:33.432832 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Tue May 24 10:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:29:41.828896 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:29:41.829441 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:29:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:29:57.595218 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=22 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:29:57.596008 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=54 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:29:57.599873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:29:57.600365 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:29:57.606822 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:29:57.607271 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:29:57.608053 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:29:57.608491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:29:57.633617 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Going to try to terminate instance {{(pid=118130) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:29:57.888915 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-6bad6f6b-272b-4114-bf64-a6934c5be732 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 204 len: 0 microversion: 2.1 time: 0.295121 May 24 10:29:57.889434 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 553/1095] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:29:57 2022] DELETE /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 24 10:29:57.895865 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:29:57.896638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=44 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:29:57.900988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:29:57.901653 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:29:57.908756 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:29:57.909203 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:29:57.909972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:29:57.910400 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:29:58.126993 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:29:58.134469 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-46a9cb3d-be69-4bda-a455-a6e1019dd54f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1580 microversion: 2.1 time: 0.240639 May 24 10:29:58.135026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 543/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:29:57 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1580 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:29:59.153294 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:29:59.153989 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:29:59.160805 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:29:59.161249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:29:59.162042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:29:59.162480 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:29:59.344654 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:29:59.352074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-4a235cd7-fefa-489f-8715-68fd12ecd5c5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1580 microversion: 2.1 time: 0.203547 May 24 10:29:59.352643 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 554/1097] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:29:59 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1580 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:29:59.836225 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:29:59.836459 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:30:00.370288 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:00.371876 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:00.378706 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:00.379100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:00.379914 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:00.380360 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:00.494340 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:00.533022 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-f83765ec-8094-4e33-beec-4e9e692d1df2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1512 microversion: 2.1 time: 0.141985 May 24 10:30:00.533022 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 544/1098] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:00 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1512 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:00.533235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-f781e477-2488-4663-b29e-79807c11626c req-85f1addf-4f6b-49a0-987a-06b7cd8bffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7601025b-ab9e-44d6-8ad3-3ef174bbccf2", "name": "network-vif-deleted", "tag": "a81cf75c-edbb-4027-8369-20688ef804fe"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:30:00.533235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-f781e477-2488-4663-b29e-79807c11626c req-85f1addf-4f6b-49a0-987a-06b7cd8bffb0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:00.533235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-f781e477-2488-4663-b29e-79807c11626c req-85f1addf-4f6b-49a0-987a-06b7cd8bffb0 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:00.533235 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-f781e477-2488-4663-b29e-79807c11626c req-85f1addf-4f6b-49a0-987a-06b7cd8bffb0 service nova] Creating event network-vif-deleted:a81cf75c-edbb-4027-8369-20688ef804fe for instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 on hv-cinder-81045 May 24 10:30:00.537122 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-f781e477-2488-4663-b29e-79807c11626c req-85f1addf-4f6b-49a0-987a-06b7cd8bffb0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 May 24 10:30:00.540805 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 555/1099] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:30:01.525786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:01.526428 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:01.532900 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:01.533608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:01.534412 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:01.534850 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:01.568997 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:01.569115 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:01.569544 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.objects.instance [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lazy-loading 'fault' on Instance uuid 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 {{(pid=118131) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 24 10:30:01.610663 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:01.618407 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-ef20d8be-1e92-4f4c-a222-a0412801630f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 200 len: 1231 microversion: 2.1 time: 0.096724 May 24 10:30:01.618964 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 545/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:01 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:02.637062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:02.637907 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:02.644364 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:02.644888 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:02.645737 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:02.646268 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:02.662819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] HTTP exception thrown: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Request method failure captured: May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 HTTP/1.1 May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLMDJRIGnpN7N4K2O9ljoW0fCE6b9mZbvIC6AIbPWGU1Pk1PTUKLJmgtZokpRxFcTec4A1Zq2ihxXpjTGaClkigBNpfsVqPikeUJViIV5SHGnK7NgqThue120AwNf4sl2jcra_059Q2wtFIeaeWWi4QDgcnqTtY40ALIiawv4DGEfDA May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:30:02.664493 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4e96acc60714f0589d31139a8bf23ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-TestVolumeBootPattern-1050833859 May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-TestVolumeBootPattern-1050833859-project May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 6ff111c533394fc6af6ee0f7488a877b May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-TestVolumeBootPattern-1050833859-project May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:30:02.666275 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '7601025b-ab9e-44d6-8ad3-3ef174bbccf2'} May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:30:02.667253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:30:02.669082 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:30:02.670859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Returning 404 to user: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:30:02.670859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-40412f70-b526-48bb-a995-a86ec081032b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 404 len: 111 microversion: 2.1 time: 0.034110 May 24 10:30:02.670859 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 556/1101] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:02 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:30:02.713327 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-77311870", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1216596019", "security_groups": [{"name": "tempest-secgroup-smoke-1022035824"}], "block_device_mapping_v2": [{"uuid": "030c2d35-8f79-4873-a4d9-6ac16c457d1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ee8b3f2-ecd6-4894-9d3f-f6828af2bc9e"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:30:02.827495 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] validate_networks() for [('0ee8b3f2-ecd6-4894-9d3f-f6828af2bc9e', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:30:03.193472 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:30:03.193919 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:30:03.194390 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:30:03.194791 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:30:03.195223 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:30:03.203836 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:03.204280 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:03.205067 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:03.205497 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:03.222371 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for project f4e96acc60714f0589d31139a8bf23ca. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:30:03.226236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for user 6ff111c533394fc6af6ee0f7488a877b and project f4e96acc60714f0589d31139a8bf23ca. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:30:03.283073 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:30:03.285567 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='030c2d35-8f79-4873-a4d9-6ac16c457d1f',volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:30:03.621317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-771e1e72-d781-4c2a-8324-fb794b98231d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.911950 May 24 10:30:03.621972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 546/1102] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:30:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:30:03.632016 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a2c367af-58c8-4ac6-a771-60255061d0b2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:03.635217 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a2c367af-58c8-4ac6-a771-60255061d0b2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:03.686518 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a2c367af-58c8-4ac6-a771-60255061d0b2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:03.693824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a2c367af-58c8-4ac6-a771-60255061d0b2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1093 microversion: 2.1 time: 0.065714 May 24 10:30:03.694372 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 557/1103] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:03 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:04.711716 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:04.712410 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:04.719942 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:04.720463 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:04.721236 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:04.721670 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:04.782815 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:04.790388 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c99ec6f3-5040-465c-b013-115c66117a7d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1143 microversion: 2.1 time: 0.083454 May 24 10:30:04.790952 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 547/1104] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:04 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:05.807925 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:05.809094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:05.815527 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:05.816019 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:05.816769 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:05.817198 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:05.899966 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:05.908096 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d09b50d0-2a86-4634-94f8-db2c5d83c72a tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1209 microversion: 2.1 time: 0.104062 May 24 10:30:05.912406 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 558/1105] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:05 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:30:06.926113 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:06.927098 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:06.935229 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:06.935857 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:06.936752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:06.937339 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:07.143706 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:07.151298 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-155af07b-5dff-4601-bde7-4c53c6957f8e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1277 microversion: 2.1 time: 0.230597 May 24 10:30:07.152587 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 548/1106] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:06 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:07.291607 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-31a0d1b6-b0cb-4c31-9ae2-ce0b3468c638 req-ae29c0dd-7bb4-4450-a1a2-515c843d4554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afdaa-c352-43cf-9787-c55fd1b292a6", "tag": "0600526d-7092-485b-9a96-429fa54f2fc5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:30:07.301532 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-31a0d1b6-b0cb-4c31-9ae2-ce0b3468c638 req-ae29c0dd-7bb4-4450-a1a2-515c843d4554 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:07.309121 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-31a0d1b6-b0cb-4c31-9ae2-ce0b3468c638 req-ae29c0dd-7bb4-4450-a1a2-515c843d4554 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:07.313816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-31a0d1b6-b0cb-4c31-9ae2-ce0b3468c638 req-ae29c0dd-7bb4-4450-a1a2-515c843d4554 service nova] Creating event network-changed:0600526d-7092-485b-9a96-429fa54f2fc5 for instance 967afdaa-c352-43cf-9787-c55fd1b292a6 on hv-cinder-81045 May 24 10:30:07.320692 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-31a0d1b6-b0cb-4c31-9ae2-ce0b3468c638 req-ae29c0dd-7bb4-4450-a1a2-515c843d4554 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033529 May 24 10:30:07.321540 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 559/1107] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:30:08.170213 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:08.170786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:08.177305 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:08.177757 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:08.178531 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:08.178958 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:08.378015 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:08.385981 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3eb8e08a-3576-4c8a-846c-b82c8de169cc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.220925 May 24 10:30:08.386778 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 549/1108] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:08 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:09.404346 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:09.405036 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:09.411189 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:09.411638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:09.412421 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:09.412858 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:09.550153 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:09.550999 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8d744c1e-1810-4395-8671-613b10beab18 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.151579 May 24 10:30:09.551664 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 560/1109] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:09 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:10.567639 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:10.568284 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:10.575412 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:10.575887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:10.576672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:10.577088 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:10.709725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:10.717418 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-583cbcc6-a501-48a3-9f25-318b97770f8f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.153642 May 24 10:30:10.717980 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 550/1110] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:10 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:11.733998 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:11.734593 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:11.740977 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:11.741422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:11.742165 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:11.742595 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:11.871061 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:11.878414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-16622802-8c1e-4e05-a5fb-4901a087a33f tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.148316 May 24 10:30:11.878969 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 561/1111] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:11 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:12.895672 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:12.896448 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:12.903624 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:12.904096 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:12.904860 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:12.905290 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:13.038316 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:13.046554 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-96d5ad50-f9f5-4039-a58f-f8529ab88818 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.154702 May 24 10:30:13.047126 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 551/1112] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:12 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:14.063232 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:14.063879 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:14.065873 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:30:14.070821 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:14.071279 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:14.072093 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:14.072533 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:14.204384 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:14.211722 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-10276afc-8764-446a-b512-d541caddcfde tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.152437 May 24 10:30:14.212313 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 562/1113] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:14 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 24 10:30:15.228733 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:15.229338 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:15.231151 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:30:15.231842 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=6 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:30:15.237099 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:15.237546 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:15.238307 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:15.238738 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:15.368008 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:15.376012 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b3fed51b-519a-42bc-9685-79655783b375 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.151122 May 24 10:30:15.376570 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 552/1114] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:15 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:16.392300 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:16.392905 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:16.399422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:16.399902 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:16.400663 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:16.401095 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:16.533475 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:16.540809 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8402677d-6bab-4e0b-9117-6bdf637ce8a4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.152379 May 24 10:30:16.541371 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 563/1115] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:16 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:17.558315 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:17.559030 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:17.566648 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:17.567100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:17.567894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:17.568335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:17.697935 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:17.705548 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0bf2609e-3927-489a-b818-a69d00a96898 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.151788 May 24 10:30:17.706104 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 553/1116] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:17 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:18.722659 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:18.723268 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:18.729913 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:18.730360 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:18.731175 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:18.731607 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:18.832474 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-f5e87ffd-5dfe-483d-9dcc-a82e1961ce6f req-ef3d83a9-a3c9-4d2c-8141-e9885b8493a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967afdaa-c352-43cf-9787-c55fd1b292a6", "name": "network-vif-plugged", "status": "completed", "tag": "0600526d-7092-485b-9a96-429fa54f2fc5"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:30:18.841704 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f5e87ffd-5dfe-483d-9dcc-a82e1961ce6f req-ef3d83a9-a3c9-4d2c-8141-e9885b8493a3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:18.842149 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-f5e87ffd-5dfe-483d-9dcc-a82e1961ce6f req-ef3d83a9-a3c9-4d2c-8141-e9885b8493a3 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:18.852971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-f5e87ffd-5dfe-483d-9dcc-a82e1961ce6f req-ef3d83a9-a3c9-4d2c-8141-e9885b8493a3 service nova] Creating event network-vif-plugged:0600526d-7092-485b-9a96-429fa54f2fc5 for instance 967afdaa-c352-43cf-9787-c55fd1b292a6 on hv-cinder-81045 May 24 10:30:18.858215 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-f5e87ffd-5dfe-483d-9dcc-a82e1961ce6f req-ef3d83a9-a3c9-4d2c-8141-e9885b8493a3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029652 May 24 10:30:18.858980 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 554/1117] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:30:18.869099 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:18.877223 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-efa78c97-6952-438c-82af-583c8f5417e0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.158528 May 24 10:30:18.877782 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 564/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:18 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:19.895463 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:19.896189 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:19.902924 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:19.903426 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:19.904255 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:19.904686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:20.032946 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:20.040302 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-e16c2f80-83a6-462c-9471-5816d4947a4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1265 microversion: 2.1 time: 0.149499 May 24 10:30:20.040867 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 555/1119] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:19 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:21.057005 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:21.057609 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:21.064538 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:21.064986 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:21.065754 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:21.066189 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:21.198500 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:21.206048 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-a619b886-5bb6-43da-a78b-81de052b840c tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1453 microversion: 2.1 time: 0.152862 May 24 10:30:21.206611 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 565/1120] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:21 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:21.222650 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:30:21.223270 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:30:21.229814 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:21.230268 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:21.231666 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:21.232134 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:21.361013 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:30:21.368703 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b3602b0c-8e7e-40bd-a3ad-38b55cef50f9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1453 microversion: 2.1 time: 0.149852 May 24 10:30:21.369276 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 556/1121] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:30:21 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:30:23.522481 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-c1dd0ff7-0bed-476d-8226-2131130760eb req-b9af57df-50be-49a2-86d7-32ab6c6e48ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afdaa-c352-43cf-9787-c55fd1b292a6", "tag": "0600526d-7092-485b-9a96-429fa54f2fc5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:30:23.532199 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-c1dd0ff7-0bed-476d-8226-2131130760eb req-b9af57df-50be-49a2-86d7-32ab6c6e48ea service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:30:23.534137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-c1dd0ff7-0bed-476d-8226-2131130760eb req-b9af57df-50be-49a2-86d7-32ab6c6e48ea service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:30:23.545137 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-c1dd0ff7-0bed-476d-8226-2131130760eb req-b9af57df-50be-49a2-86d7-32ab6c6e48ea service nova] Creating event network-changed:0600526d-7092-485b-9a96-429fa54f2fc5 for instance 967afdaa-c352-43cf-9787-c55fd1b292a6 on hv-cinder-81045 May 24 10:30:23.550418 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-c1dd0ff7-0bed-476d-8226-2131130760eb req-b9af57df-50be-49a2-86d7-32ab6c6e48ea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031965 May 24 10:30:23.554816 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 566/1122] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:31:01.435924 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:31:01.436622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:31:51.974224 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:31:51.979786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=78 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:31:51.979786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-164095280", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1216596019", "security_groups": [{"name": "tempest-secgroup-smoke-1022035824"}], "block_device_mapping_v2": [{"uuid": "c3d5104b-b675-43be-b488-2a37342f135c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0ee8b3f2-ecd6-4894-9d3f-f6828af2bc9e"}]}} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:31:52.088376 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.network.neutron [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] validate_networks() for [('0ee8b3f2-ecd6-4894-9d3f-f6828af2bc9e', None, None, None, None, None)] {{(pid=118131) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 24 10:31:52.439921 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Flavor limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 24 10:31:52.440344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Image limits 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 24 10:31:52.440810 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Flavor pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 24 10:31:52.441217 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Image pref 0:0:0 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 24 10:31:52.441626 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.virt.hardware [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118131) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 24 10:31:52.450328 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:52.451406 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:52.452317 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:52.452751 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:52.470009 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for project f4e96acc60714f0589d31139a8bf23ca. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 24 10:31:52.473859 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.quota [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Getting quotas for user 6ff111c533394fc6af6ee0f7488a877b and project f4e96acc60714f0589d31139a8bf23ca. Resources: {'ram', 'cores', 'instances'} {{(pid=118131) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 24 10:31:52.530706 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Going to run 1 instances... {{(pid=118131) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 24 10:31:52.532817 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3d5104b-b675-43be-b488-2a37342f135c',volume_size=None,volume_type=None)] {{(pid=118131) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 24 10:31:52.842003 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-380a3a02-d048-4d23-9e22-a1874333a2a8 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.869440 May 24 10:31:52.842637 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 557/1123] 10.222.0.44 () {60 vars in 1146 bytes} [Tue May 24 10:31:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 24 10:31:52.851039 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:31:52.851792 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:31:52.855825 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-bd3ae718-7c01-4363-889b-74f2b0eadee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:31:52.856707 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-bd3ae718-7c01-4363-889b-74f2b0eadee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:31:52.910280 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-bd3ae718-7c01-4363-889b-74f2b0eadee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:31:52.917668 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-bd3ae718-7c01-4363-889b-74f2b0eadee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1094 microversion: 2.1 time: 0.068807 May 24 10:31:52.918227 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 567/1124] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:31:52 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:31:53.935356 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-9afabbf3-98ad-47fd-b882-e378be2e472d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:31:53.936119 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-9afabbf3-98ad-47fd-b882-e378be2e472d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:31:53.991331 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-9afabbf3-98ad-47fd-b882-e378be2e472d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:31:53.997920 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-9afabbf3-98ad-47fd-b882-e378be2e472d tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1094 microversion: 2.1 time: 0.067301 May 24 10:31:53.998488 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 558/1125] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:31:53 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:31:55.014658 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:31:55.016059 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:31:55.023971 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:55.024424 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:55.025181 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:55.025644 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:55.085921 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:31:55.094025 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-95b7a982-ac8d-4d9f-b384-f3a2b499f127 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1136 microversion: 2.1 time: 0.083948 May 24 10:31:55.094582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 568/1126] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:31:55 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:31:56.111116 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:31:56.111908 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:31:56.118582 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:56.119042 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:56.119915 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:56.120355 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:56.191922 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:31:56.199191 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-a6e72f6d-4e7b-4a3f-93b2-ad6e2f05e66e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1210 microversion: 2.1 time: 0.092097 May 24 10:31:56.199767 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 559/1127] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:31:56 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:31:57.217460 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:31:57.219051 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:31:57.226238 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:57.227257 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:57.228501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:57.229284 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:57.668501 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:31:57.675956 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-0fbad5fb-dc48-4c64-9706-251fc4561629 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1278 microversion: 2.1 time: 0.462966 May 24 10:31:57.676524 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 569/1128] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:31:57 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1278 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:31:57.818972 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [req-a26dbb5f-30b1-47c5-9a9c-6a1f4a2ee434 req-2e6ff140-06ce-4940-b620-558d38227359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f668d4cf-ad32-493b-88a7-33a5410faea1", "tag": "2c06a669-45ac-4a00-96ad-ca75b97b2e80"}]} {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:31:57.831638 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a26dbb5f-30b1-47c5-9a9c-6a1f4a2ee434 req-2e6ff140-06ce-4940-b620-558d38227359 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:57.832435 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [req-a26dbb5f-30b1-47c5-9a9c-6a1f4a2ee434 req-2e6ff140-06ce-4940-b620-558d38227359 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:57.845970 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.compute.server_external_events [req-a26dbb5f-30b1-47c5-9a9c-6a1f4a2ee434 req-2e6ff140-06ce-4940-b620-558d38227359 service nova] Creating event network-changed:2c06a669-45ac-4a00-96ad-ca75b97b2e80 for instance f668d4cf-ad32-493b-88a7-33a5410faea1 on hv-cinder-81045 May 24 10:31:57.851365 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [req-a26dbb5f-30b1-47c5-9a9c-6a1f4a2ee434 req-2e6ff140-06ce-4940-b620-558d38227359 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035946 May 24 10:31:57.852008 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 560/1129] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:31:58.693274 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:31:58.693824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:31:58.700314 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:58.701519 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:58.702292 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:58.702727 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:58.831066 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:31:58.838693 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-93177879-dd98-4031-95d4-6052ec5356fa tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.149360 May 24 10:31:58.839514 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 570/1130] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:31:58 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:31:59.856990 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:31:59.857786 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:31:59.863988 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:59.864442 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:59.865208 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:31:59.865642 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:31:59.998449 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:00.006095 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0e24dc1d-75a7-439c-a58b-19bababb6cf4 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.153859 May 24 10:32:00.006699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 561/1131] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:31:59 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:01.023678 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:01.024345 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:01.031356 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:01.031819 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:01.032655 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:01.033091 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:01.161069 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:01.168431 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-534ad8c0-a341-4540-b223-52003cbc9eac tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.148649 May 24 10:32:01.169000 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 571/1132] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:01 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:02.184637 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:02.185259 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:02.191263 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:02.191713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:02.192508 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:02.192950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:02.326206 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:02.333902 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-b67d465f-4105-49e6-a93a-d8038883ee12 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.153266 May 24 10:32:02.334492 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 562/1133] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:02 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:03.350661 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:03.351264 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:03.353626 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell0:SELECT=2 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:32:03.358636 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:03.359083 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:03.359871 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:03.360307 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:03.491881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:03.499414 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-e508bd06-8c75-4259-b44f-c734a00feca5 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.152562 May 24 10:32:03.499988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 572/1134] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:03 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:04.516171 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:04.516781 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:04.518731 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=2 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:32:04.519888 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell0:SELECT=8 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:32:04.524735 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:04.526444 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:04.526444 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:04.526444 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:04.656789 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:04.664159 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-3b93ca66-c589-4ae7-a5c3-cc14bf3a7803 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.152044 May 24 10:32:04.664725 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 563/1135] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:04 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:05.681354 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:05.682001 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:05.688619 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:05.689074 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:05.689853 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:05.690293 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:05.829824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:05.837222 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-8ac10713-04eb-45d3-b59d-9a7c4c68ba52 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.159752 May 24 10:32:05.837784 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 573/1136] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:05 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:06.854727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:06.855333 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:06.863450 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:06.864261 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:06.864777 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:06.865233 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:06.995822 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:07.003389 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-fba16aea-e760-45fa-80fa-9531ac8e93bc tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.152521 May 24 10:32:07.007783 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 564/1137] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:06 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:07.315042 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-30013334-3c1d-4d9a-a946-e5e573a68a9c req-b4d4b01c-7ec0-4048-a385-b4075d73aa01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f668d4cf-ad32-493b-88a7-33a5410faea1", "name": "network-vif-plugged", "status": "completed", "tag": "2c06a669-45ac-4a00-96ad-ca75b97b2e80"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:32:07.323005 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-30013334-3c1d-4d9a-a946-e5e573a68a9c req-b4d4b01c-7ec0-4048-a385-b4075d73aa01 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:07.323440 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-30013334-3c1d-4d9a-a946-e5e573a68a9c req-b4d4b01c-7ec0-4048-a385-b4075d73aa01 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:07.335283 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-30013334-3c1d-4d9a-a946-e5e573a68a9c req-b4d4b01c-7ec0-4048-a385-b4075d73aa01 service nova] Creating event network-vif-plugged:2c06a669-45ac-4a00-96ad-ca75b97b2e80 for instance f668d4cf-ad32-493b-88a7-33a5410faea1 on hv-cinder-81045 May 24 10:32:07.341796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-30013334-3c1d-4d9a-a946-e5e573a68a9c req-b4d4b01c-7ec0-4048-a385-b4075d73aa01 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084635 May 24 10:32:07.342729 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 574/1138] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:32:08.021271 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:08.021821 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:08.028965 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:08.029424 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:08.030195 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:08.030634 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:08.157048 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:08.164452 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c82279da-5eb0-42f3-8622-886b43299971 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1266 microversion: 2.1 time: 0.147155 May 24 10:32:08.165025 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 565/1139] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:08 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:09.182195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:09.182881 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:09.189729 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:09.190168 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:09.190938 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:09.191346 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:09.326645 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:09.335049 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-dd455598-1d70-4f66-9855-440e51e5b085 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1453 microversion: 2.1 time: 0.156993 May 24 10:32:09.335671 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 575/1140] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:09 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:09.352099 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:32:09.352711 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:32:09.359908 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:09.360358 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:09.361150 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:09.361585 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:09.491713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:32:09.499676 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-c96e3d08-ca87-43dd-a9bc-034dc7ecc007 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1453 microversion: 2.1 time: 0.151436 May 24 10:32:09.500266 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 566/1141] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:32:09 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:32:11.370988 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-96c5df62-9c05-47f9-b05d-345996137114 req-4978e0d4-3c94-4ecc-bd3d-f5ad1a48f0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f668d4cf-ad32-493b-88a7-33a5410faea1", "tag": "2c06a669-45ac-4a00-96ad-ca75b97b2e80"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:32:11.379138 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-96c5df62-9c05-47f9-b05d-345996137114 req-4978e0d4-3c94-4ecc-bd3d-f5ad1a48f0e6 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:32:11.379573 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-96c5df62-9c05-47f9-b05d-345996137114 req-4978e0d4-3c94-4ecc-bd3d-f5ad1a48f0e6 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:32:11.390506 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-96c5df62-9c05-47f9-b05d-345996137114 req-4978e0d4-3c94-4ecc-bd3d-f5ad1a48f0e6 service nova] Creating event network-changed:2c06a669-45ac-4a00-96ad-ca75b97b2e80 for instance f668d4cf-ad32-493b-88a7-33a5410faea1 on hv-cinder-81045 May 24 10:32:11.395435 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-96c5df62-9c05-47f9-b05d-345996137114 req-4978e0d4-3c94-4ecc-bd3d-f5ad1a48f0e6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085491 May 24 10:32:11.396079 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 576/1142] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:32:53.441376 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:32:53.441918 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Tue May 24 10:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:33:19.845965 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:33:19.846601 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:33:51.045134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_api:SELECT=22 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:33:51.045950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:51.045950 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:51.046422 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG dbcounter [-] [118130] Writing DB stats nova_cell1:SELECT=46 {{(pid=118130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:33:51.049318 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:33:51.049971 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG dbcounter [-] [118131] Writing DB stats nova_cell1:SELECT=46 {{(pid=118131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 24 10:33:51.051172 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-ca6c431d-2e31-4b63-93d5-560eeee7c241 req-77ff2766-5bac-4eb3-afa8-483c2442e7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f668d4cf-ad32-493b-88a7-33a5410faea1", "tag": "2c06a669-45ac-4a00-96ad-ca75b97b2e80"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:33:51.053481 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:51.053922 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:51.054686 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:51.055344 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:51.061613 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-ca6c431d-2e31-4b63-93d5-560eeee7c241 req-77ff2766-5bac-4eb3-afa8-483c2442e7c5 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:51.068383 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-ca6c431d-2e31-4b63-93d5-560eeee7c241 req-77ff2766-5bac-4eb3-afa8-483c2442e7c5 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:51.073335 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-ca6c431d-2e31-4b63-93d5-560eeee7c241 req-77ff2766-5bac-4eb3-afa8-483c2442e7c5 service nova] Creating event network-changed:2c06a669-45ac-4a00-96ad-ca75b97b2e80 for instance f668d4cf-ad32-493b-88a7-33a5410faea1 on hv-cinder-81045 May 24 10:33:51.079584 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-ca6c431d-2e31-4b63-93d5-560eeee7c241 req-77ff2766-5bac-4eb3-afa8-483c2442e7c5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036641 May 24 10:33:51.080486 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 577/1143] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:33:51.084792 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:33:51.360393 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-12f1b29f-fa23-4aa4-9a85-f8f86138e4c2 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 204 len: 0 microversion: 2.1 time: 0.319652 May 24 10:33:51.361308 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 567/1144] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:33:51 2022] DELETE /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:33:51.370749 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:51.371746 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:51.381423 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:51.382170 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:51.383615 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:51.384492 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:51.526669 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:33:51.535004 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-1fb72d07-972c-4da4-9f0d-4420ca482af0 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1578 microversion: 2.1 time: 0.169115 May 24 10:33:51.535569 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 578/1145] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:33:51 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:33:52.552485 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:52.553393 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:52.560052 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:52.560608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:52.561427 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:52.561863 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:52.706894 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:33:52.714392 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-5dab448f-31e7-4450-8334-0bef421d2d54 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1578 microversion: 2.1 time: 0.166224 May 24 10:33:52.714946 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 568/1146] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:33:52 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:33:53.513884 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-6c798a09-722d-4ad8-9d9c-c6ae61c511f2 req-2709208e-b80b-4384-8588-4ed726f05ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f668d4cf-ad32-493b-88a7-33a5410faea1", "name": "network-vif-deleted", "tag": "2c06a669-45ac-4a00-96ad-ca75b97b2e80"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:33:53.522136 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-6c798a09-722d-4ad8-9d9c-c6ae61c511f2 req-2709208e-b80b-4384-8588-4ed726f05ddb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:53.522578 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-6c798a09-722d-4ad8-9d9c-c6ae61c511f2 req-2709208e-b80b-4384-8588-4ed726f05ddb service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:53.533567 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-6c798a09-722d-4ad8-9d9c-c6ae61c511f2 req-2709208e-b80b-4384-8588-4ed726f05ddb service nova] Creating event network-vif-deleted:2c06a669-45ac-4a00-96ad-ca75b97b2e80 for instance f668d4cf-ad32-493b-88a7-33a5410faea1 on hv-cinder-81045 May 24 10:33:53.538553 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-6c798a09-722d-4ad8-9d9c-c6ae61c511f2 req-2709208e-b80b-4384-8588-4ed726f05ddb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028334 May 24 10:33:53.539129 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 579/1147] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:33:53.733618 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:53.734152 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:53.740563 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:53.741013 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:53.741774 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:53.742212 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:53.803630 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:33:53.811713 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-1535974b-8f29-43ad-988e-a2c9cb71d4a9 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 200 len: 1225 microversion: 2.1 time: 0.082520 May 24 10:33:53.812335 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 569/1148] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:33:53 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:33:54.829824 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:54.833381 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: f668d4cf-ad32-493b-88a7-33a5410faea1] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:54.837800 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:54.838244 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:54.839034 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:54.839474 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:54.852905 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] HTTP exception thrown: Instance f668d4cf-ad32-493b-88a7-33a5410faea1 could not be found. May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Request method failure captured: May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 HTTP/1.1 May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLMDJRIGnpN7N4K2O9ljoW0fCE6b9mZbvIC6AIbPWGU1Pk1PTUKLJmgtZokpRxFcTec4A1Zq2ihxXpjTGaClkigBNpfsVqPikeUJViIV5SHGnK7NgqThue120AwNf4sl2jcra_059Q2wtFIeaeWWi4QDgcnqTtY40ALIiawv4DGEfDA May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:33:54.854491 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4e96acc60714f0589d31139a8bf23ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-TestVolumeBootPattern-1050833859 May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-TestVolumeBootPattern-1050833859-project May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 6ff111c533394fc6af6ee0f7488a877b May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-TestVolumeBootPattern-1050833859-project May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance f668d4cf-ad32-493b-88a7-33a5410faea1 could not be found. May 24 10:33:54.856337 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': 'f668d4cf-ad32-493b-88a7-33a5410faea1'} May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f668d4cf-ad32-493b-88a7-33a5410faea1 could not be found. May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:33:54.857874 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f668d4cf-ad32-493b-88a7-33a5410faea1 could not be found. May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f668d4cf-ad32-493b-88a7-33a5410faea1 could not be found. May 24 10:33:54.859348 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:33:54.860717 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Returning 404 to user: Instance f668d4cf-ad32-493b-88a7-33a5410faea1 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:33:54.860717 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-cef2286f-ccef-4078-b23b-39ba46e65333 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1" status: 404 len: 111 microversion: 2.1 time: 0.031581 May 24 10:33:54.860717 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 580/1149] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:33:54 2022] GET /compute/v2.1/servers/f668d4cf-ad32-493b-88a7-33a5410faea1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:33:58.137577 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:58.138399 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:58.145393 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:58.145956 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:58.147192 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:58.147737 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:58.176071 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Going to try to terminate instance {{(pid=118131) delete /opt/stack/nova/nova/compute/api.py:2664}} May 24 10:33:58.196622 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-d7d90daf-f5cf-4964-a7ae-5f5bf17c5856 req-772537ff-4995-46f3-a688-81387cc7d2ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afdaa-c352-43cf-9787-c55fd1b292a6", "tag": "0600526d-7092-485b-9a96-429fa54f2fc5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:33:58.204982 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-d7d90daf-f5cf-4964-a7ae-5f5bf17c5856 req-772537ff-4995-46f3-a688-81387cc7d2ef service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:58.205419 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-d7d90daf-f5cf-4964-a7ae-5f5bf17c5856 req-772537ff-4995-46f3-a688-81387cc7d2ef service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:58.218060 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-d7d90daf-f5cf-4964-a7ae-5f5bf17c5856 req-772537ff-4995-46f3-a688-81387cc7d2ef service nova] Creating event network-changed:0600526d-7092-485b-9a96-429fa54f2fc5 for instance 967afdaa-c352-43cf-9787-c55fd1b292a6 on hv-cinder-81045 May 24 10:33:58.223580 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-d7d90daf-f5cf-4964-a7ae-5f5bf17c5856 req-772537ff-4995-46f3-a688-81387cc7d2ef service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087778 May 24 10:33:58.223904 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 581/1150] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 24 10:33:58.490752 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-2d516a18-0a25-4ad7-903c-d43560c87834 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "DELETE /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 204 len: 0 microversion: 2.1 time: 0.356833 May 24 10:33:58.493238 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 570/1151] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:33:58 2022] DELETE /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 24 10:33:58.504115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:58.504115 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:58.512253 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:58.512619 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:58.513393 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:58.513835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:58.649945 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.policy [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118130) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:33:58.657928 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-c0e2f684-62ae-472a-8ca6-7cdafe9a456e tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1578 microversion: 2.1 time: 0.159703 May 24 10:33:58.658500 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 582/1152] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:33:58 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:33:59.675566 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:33:59.676295 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:33:59.682350 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:59.682800 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:59.683560 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:33:59.684026 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:33:59.883508 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:33:59.892842 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0025417e-80d5-4442-a18c-d086fa1b0f55 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1578 microversion: 2.1 time: 0.222045 May 24 10:33:59.893405 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 571/1153] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:33:59 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:34:00.567638 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [req-e0bc4934-73a7-4783-99fb-cf9050c07a17 req-b6ad70bd-5144-40f4-b160-d296e406b982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967afdaa-c352-43cf-9787-c55fd1b292a6", "name": "network-vif-deleted", "tag": "0600526d-7092-485b-9a96-429fa54f2fc5"}]} {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 24 10:34:00.576249 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-e0bc4934-73a7-4783-99fb-cf9050c07a17 req-b6ad70bd-5144-40f4-b160-d296e406b982 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:00.579062 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [req-e0bc4934-73a7-4783-99fb-cf9050c07a17 req-b6ad70bd-5144-40f4-b160-d296e406b982 service nova] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:00.589266 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.compute.server_external_events [req-e0bc4934-73a7-4783-99fb-cf9050c07a17 req-b6ad70bd-5144-40f4-b160-d296e406b982 service nova] Creating event network-vif-deleted:0600526d-7092-485b-9a96-429fa54f2fc5 for instance 967afdaa-c352-43cf-9787-c55fd1b292a6 on hv-cinder-81045 May 24 10:34:00.595205 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [req-e0bc4934-73a7-4783-99fb-cf9050c07a17 req-b6ad70bd-5144-40f4-b160-d296e406b982 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031308 May 24 10:34:00.595883 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 583/1154] 10.222.0.44 () {64 vars in 1317 bytes} [Tue May 24 10:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 24 10:34:00.910366 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:34:00.911747 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:34:00.917887 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:00.918331 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:00.919282 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:00.919727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:00.988164 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.policy [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ff111c533394fc6af6ee0f7488a877b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e96acc60714f0589d31139a8bf23ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118131) authorize /opt/stack/nova/nova/policy.py:199}} May 24 10:34:00.995837 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-97ee5f84-b739-4dcd-8821-28993ad22469 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 200 len: 1224 microversion: 2.1 time: 0.090699 May 24 10:34:00.996699 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 572/1155] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:34:00 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 24 10:34:02.013383 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:34:02.014081 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 967afdaa-c352-43cf-9787-c55fd1b292a6] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:34:02.021094 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:02.021549 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:02.022312 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:02.022752 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:02.035762 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] HTTP exception thrown: Instance 967afdaa-c352-43cf-9787-c55fd1b292a6 could not be found. May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Request method failure captured: May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 HTTP/1.1 May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLMDJRIGnpN7N4K2O9ljoW0fCE6b9mZbvIC6AIbPWGU1Pk1PTUKLJmgtZokpRxFcTec4A1Zq2ihxXpjTGaClkigBNpfsVqPikeUJViIV5SHGnK7NgqThue120AwNf4sl2jcra_059Q2wtFIeaeWWi4QDgcnqTtY40ALIiawv4DGEfDA May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:34:02.037375 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4e96acc60714f0589d31139a8bf23ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-TestVolumeBootPattern-1050833859-project May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 6ff111c533394fc6af6ee0f7488a877b May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-TestVolumeBootPattern-1050833859-project May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 967afdaa-c352-43cf-9787-c55fd1b292a6 could not be found. May 24 10:34:02.039134 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '967afdaa-c352-43cf-9787-c55fd1b292a6'} May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967afdaa-c352-43cf-9787-c55fd1b292a6 could not be found. May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:34:02.040169 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967afdaa-c352-43cf-9787-c55fd1b292a6 could not be found. May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967afdaa-c352-43cf-9787-c55fd1b292a6 could not be found. May 24 10:34:02.041796 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.043290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Returning 404 to user: Instance 967afdaa-c352-43cf-9787-c55fd1b292a6 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:34:02.043290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-52f3f542-64e1-4ae0-b033-10effc18ce68 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6" status: 404 len: 111 microversion: 2.1 time: 0.030133 May 24 10:34:02.043290 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 584/1156] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:34:02 2022] GET /compute/v2.1/servers/967afdaa-c352-43cf-9787-c55fd1b292a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:34:02.549608 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:34:02.550100 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.compute.api [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118131) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:34:02.556598 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:02.557042 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:02.557787 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:02.558216 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG oslo_concurrency.lockutils [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118131) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:02.571898 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.wsgi [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] HTTP exception thrown: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Request method failure captured: May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: request: DELETE /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 HTTP/1.1 May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept: application/json May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Accept-Encoding: identity May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Connection: close May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Length: 0 May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Content-Type: application/json May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Host: 10.222.0.44 May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Openstack-System-Scope: None May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: User-Agent: python-urllib3/1.26.9 May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Auth-Token: gAAAAABijLMDJRIGnpN7N4K2O9ljoW0fCE6b9mZbvIC6AIbPWGU1Pk1PTUKLJmgtZokpRxFcTec4A1Zq2ihxXpjTGaClkigBNpfsVqPikeUJViIV5SHGnK7NgqThue120AwNf4sl2jcra_059Q2wtFIeaeWWi4QDgcnqTtY40ALIiawv4DGEfDA May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Id: None May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Domain-Name: None May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Identity-Status: Confirmed May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Is-Admin-Project: True May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Id: default May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Domain-Name: Default May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Project-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Role: reader,member May 24 10:34:02.573542 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Roles: reader,member May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4e96acc60714f0589d31139a8bf23ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User: tempest-TestVolumeBootPattern-1050833859-project May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Id: default May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Domain-Name: Default May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Id: 6ff111c533394fc6af6ee0f7488a877b May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: X-User-Name: tempest-TestVolumeBootPattern-1050833859-project May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: method: > May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: exception: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.575177 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: action_args: {'id': '7601025b-ab9e-44d6-8ad3-3ef174bbccf2'} May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:34:02.576075 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.578060 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: ERROR nova.api.openstack.wsgi May 24 10:34:02.579576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Returning 404 to user: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. {{(pid=118131) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:34:02.579576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-88e85e3b-6205-44ab-8c2d-a4ec9aeb0ee3 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 404 len: 111 microversion: 2.1 time: 0.029299 May 24 10:34:02.579576 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 573/1157] 10.222.0.44 () {58 vars in 1238 bytes} [Tue May 24 10:34:02 2022] DELETE /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:34:02.584582 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '>' {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:34:02.585195 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.compute.api [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] [instance: 7601025b-ab9e-44d6-8ad3-3ef174bbccf2] Fetching instance by UUID {{(pid=118130) get /opt/stack/nova/nova/compute/api.py:2920}} May 24 10:34:02.592376 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:02.593539 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:02.594397 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 24 10:34:02.594835 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG oslo_concurrency.lockutils [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Lock "5a7fc9cc-559b-4c6a-9445-47ad843e2912" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118130) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 24 10:34:02.608038 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.wsgi [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] HTTP exception thrown: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Request method failure captured: May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: request: GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 HTTP/1.1 May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept: application/json May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Accept-Encoding: identity May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Connection: close May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Length: 0 May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Content-Type: application/json May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Host: 10.222.0.44 May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Openstack-System-Scope: None May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: User-Agent: python-urllib3/1.26.9 May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Auth-Token: gAAAAABijLMDJRIGnpN7N4K2O9ljoW0fCE6b9mZbvIC6AIbPWGU1Pk1PTUKLJmgtZokpRxFcTec4A1Zq2ihxXpjTGaClkigBNpfsVqPikeUJViIV5SHGnK7NgqThue120AwNf4sl2jcra_059Q2wtFIeaeWWi4QDgcnqTtY40ALIiawv4DGEfDA May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Id: None May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Domain-Name: None May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Identity-Status: Confirmed May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Is-Admin-Project: True May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Id: default May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Domain-Name: Default May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Project-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Role: reader,member May 24 10:34:02.610054 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Roles: reader,member May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f4e96acc60714f0589d31139a8bf23ca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f4e96acc60714f0589d31139a8bf23ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Id: f4e96acc60714f0589d31139a8bf23ca May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-Tenant-Name: tempest-TestVolumeBootPattern-1050833859 May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User: tempest-TestVolumeBootPattern-1050833859-project May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Id: default May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Domain-Name: Default May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Id: 6ff111c533394fc6af6ee0f7488a877b May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: X-User-Name: tempest-TestVolumeBootPattern-1050833859-project May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: method: > May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: exception: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.611882 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: action_args: {'id': '7601025b-ab9e-44d6-8ad3-3ef174bbccf2'} May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: {{(pid=118130) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 24 10:34:02.612760 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. May 24 10:34:02.614148 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: ERROR nova.api.openstack.wsgi May 24 10:34:02.615411 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: DEBUG nova.api.openstack.wsgi [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Returning 404 to user: Instance 7601025b-ab9e-44d6-8ad3-3ef174bbccf2 could not be found. {{(pid=118130) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 24 10:34:02.615411 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO nova.api.openstack.requestlog [None req-d2447d9e-06d2-4812-b6e5-204a380e1c07 tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2" status: 404 len: 111 microversion: 2.1 time: 0.030749 May 24 10:34:02.615411 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: [pid: 118130|app: 0|req: 585/1158] 10.222.0.44 () {58 vars in 1235 bytes} [Tue May 24 10:34:02 2022] GET /compute/v2.1/servers/7601025b-ab9e-44d6-8ad3-3ef174bbccf2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 24 10:34:04.077727 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: DEBUG nova.api.openstack.wsgi [None req-0a68c219-1e7f-467c-a3ad-a565a7745f4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] Calling method '.version_select at 0x7ff6400d98b0>' {{(pid=118131) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 24 10:34:04.154682 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO nova.api.openstack.requestlog [None req-0a68c219-1e7f-467c-a3ad-a565a7745f4b tempest-TestVolumeBootPattern-1050833859 tempest-TestVolumeBootPattern-1050833859-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1216596019" status: 202 len: 0 microversion: 2.1 time: 0.081208 May 24 10:34:04.155823 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: [pid: 118131|app: 0|req: 574/1159] 10.222.0.44 () {58 vars in 1262 bytes} [Tue May 24 10:34:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1216596019 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 24 10:34:21.444929 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:34:21.445478 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:36:39.854145 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:36:39.854923 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:37:41.453334 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:37:41.453922 dv-cinder-810457-9-iscsi devstack@n-api.service[118130]: Tue May 24 10:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 24 10:37:44.082417 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 24 10:37:44.083044 dv-cinder-810457-9-iscsi devstack@n-api.service[118131]: Tue May 24 10:37:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!